-- Logs begin at Wed 2022-06-15 21:24:34 UTC, end at Wed 2022-06-15 22:37:11 UTC. -- Jun 15 22:06:49.037564 dv-cinder-835384-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 22:06:49.045376 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 22:06:49 2022] *** Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: nodename: dv-cinder-835384-7-iscsi Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: machine: x86_64 Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: clock source: unix Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: pcre jit disabled Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: detected number of CPU cores: 4 Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: current working directory: / Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: detected binary path: /usr/bin/uwsgi-core Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: your processes number limit is 47680 Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: your memory page size is 4096 bytes Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: detected max file descriptor number: 2048 Jun 15 22:06:49.047401 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: lock engine: pthread robust mutexes Jun 15 22:06:49.048332 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: thunder lock: enabled Jun 15 22:06:49.048332 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 22:06:49.048332 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 22:06:49.092348 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: Python main interpreter initialized at 0x559505f699c0 Jun 15 22:06:49.092348 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: python threads support enabled Jun 15 22:06:49.092348 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: your server socket listen backlog is limited to 100 connections Jun 15 22:06:49.092348 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: your mercy for graceful operations on workers is 90 seconds Jun 15 22:06:49.092784 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 22:06:49.092784 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: *** Operational MODE: preforking *** Jun 15 22:06:49.093090 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: *** uWSGI is running in multiple interpreter mode *** Jun 15 22:06:49.093090 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: spawned uWSGI master process (pid: 103247) Jun 15 22:06:49.093354 dv-cinder-835384-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 22:06:49.094782 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: spawned uWSGI worker 1 (pid: 103248, cores: 1) Jun 15 22:06:49.094782 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: spawned uWSGI worker 2 (pid: 103249, cores: 1) Jun 15 22:06:49.094782 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 22:06:49.759424 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 22:06:49.779766 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 22:06:50.933050 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:06:50.933050 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: from cryptography.utils import int_from_bytes Jun 15 22:06:50.933721 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:06:50.933721 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: from cryptography.utils import int_from_bytes Jun 15 22:06:51.180058 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:06:51.180058 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: from cryptography.utils import int_from_bytes Jun 15 22:06:51.180733 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:06:51.180733 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: from cryptography.utils import int_from_bytes Jun 15 22:06:53.519206 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 22:06:53.519791 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 22:06:53.519881 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 22:06:53.520241 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 22:06:53.520495 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 22:06:53.520883 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.521207 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.521551 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.521866 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.522201 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.522509 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.522836 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.523146 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.523477 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.523734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.524058 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.524382 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-7-iscsi {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.524685 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.524993 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.525302 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.525682 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.525990 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.526312 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.526643 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.527125 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.528601 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.528601 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.528601 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.528601 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.529106 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.529106 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.529444 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.529755 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.530063 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.530371 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.530782 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-7-iscsi {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.531468 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.531784 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.532099 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.532525 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.532838 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.533149 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.533510 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.533869 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.534180 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.534509 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.534830 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.535148 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.535467 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.535770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.536080 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.536394 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.536712 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.537021 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.537348 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.537598 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.537909 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.538234 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.538556 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.538882 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.539136 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.539388 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.539705 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.540026 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.540335 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.540644 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.540951 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.541701 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.541942 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.542077 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.542338 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.542647 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.542967 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.543285 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.543612 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.543929 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.544331 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.544655 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.544908 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.545218 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.545588 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.545907 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.546218 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.546538 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.546859 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.547169 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.547480 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.547786 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.548106 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.548443 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.548749 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.549000 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.549306 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.549637 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.549955 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.550262 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.550571 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.550877 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.551176 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.551504 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.551792 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.552102 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.552410 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.552716 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.553024 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.553405 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.553662 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.553975 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.554295 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.554616 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.554946 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.555232 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.555537 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.555845 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.556164 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.556471 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.556775 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.557129 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.557472 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.557770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.558088 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.558396 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.558704 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.559024 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.559324 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.559630 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.559948 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.560566 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.560566 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.560874 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.561142 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.561473 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.561780 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.562084 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.562470 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.562690 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.563006 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.563326 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.563635 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.563946 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.564251 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.564576 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.564916 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.565247 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.565620 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.565932 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.566266 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.566596 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.566918 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.567230 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.567545 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.567871 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.568183 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.568495 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.568810 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.569123 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.569469 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.569801 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.570120 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.570513 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.570755 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.571068 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.571387 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.571717 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.572040 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.572352 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.572894 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.573306 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.573662 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.573999 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.574804 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.574804 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.575067 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.575242 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.575564 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.575916 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.576215 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.576678 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.576845 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.577157 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.577489 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.577806 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.578121 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.578457 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.578772 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.579089 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.579400 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.579718 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.580029 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.580341 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.580651 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.580957 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.581262 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.581596 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.581904 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.582208 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.582530 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.582858 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.583165 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.583502 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.583808 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.584123 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.584432 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.584743 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.585050 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.585378 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.585690 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.585995 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.586318 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.586627 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.586931 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.587260 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.587560 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.587864 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.588225 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.588537 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.588883 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.589274 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.589604 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.589926 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.590242 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.590559 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.590894 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.591227 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.591535 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.591856 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.592181 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.592498 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.592801 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.593110 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.593439 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.593746 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.594057 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.594364 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.594667 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.594970 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.595274 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.595608 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.595882 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.596201 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.596508 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.596811 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.597116 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.597450 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.597798 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.598105 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.598446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.598780 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.599097 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.599417 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.599730 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.600047 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.600357 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.600669 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.600979 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.601288 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.601629 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.601941 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.602261 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.602578 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.602901 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.603211 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.603531 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.604024 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.604435 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.604776 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.605110 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.605455 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.605585 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 22:06:53.606041 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.606184 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 22:06:53.606312 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.606432 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 22:06:53.606553 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.606671 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.606779 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 22:06:53.606951 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 22:06:53.607074 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.607262 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.607393 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.607572 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.607702 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.607892 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.608016 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.608201 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.608331 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.608517 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.608648 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.608827 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.608953 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.609147 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.609271 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.609477 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.609612 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.609794 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.609930 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.610080 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.610212 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.610396 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.610520 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.610717 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-7-iscsi {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.610841 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.611037 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.611160 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.611344 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.611469 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.611653 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.611784 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.611970 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.612091 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.612273 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.612397 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.612580 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.612727 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.612882 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.613004 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.613183 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.613407 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.613554 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.613721 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.613857 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.614026 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.614159 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.614339 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.614462 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.614682 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.614807 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.614991 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.615114 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.615369 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.615501 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.615623 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.615741 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.615874 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.615996 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.616181 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.616305 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.616493 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.616618 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.616813 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.616933 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-7-iscsi {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.617123 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.617246 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.617467 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.617592 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.617787 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.617919 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.618093 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.618217 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.618396 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.618520 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.618718 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.618843 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.619027 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.619166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.619329 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.619609 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.619735 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.619930 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.620054 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.620263 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.620470 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.620606 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.620786 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.620911 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.621093 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.621225 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.621434 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.621572 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.621759 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.621884 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.622072 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.622202 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.622386 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.622518 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.622690 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.622811 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.622996 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.623121 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.623248 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.623367 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.623543 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.623666 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.623864 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.623989 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.624184 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.624306 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.624506 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.624631 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.624760 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.624882 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.625001 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.625122 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.625300 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.625560 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.625693 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.625813 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.625933 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.626114 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.626240 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.626439 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.626562 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.626715 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.626849 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.627024 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.627157 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.627341 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.627465 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.627699 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.627924 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.628048 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.628257 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.628381 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.628572 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.628703 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.628891 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.629015 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.629208 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.629371 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.629551 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.629675 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.629879 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.630002 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.630187 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.630311 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.630495 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.630631 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.630834 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.630975 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.631142 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.631274 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.631446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.631578 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.631751 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.631874 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.632061 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.632198 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.632363 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.632490 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.632666 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.632788 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.632970 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.633095 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.633278 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.633464 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.633610 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.633733 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.633917 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.634050 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.634225 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.634349 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.634527 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.634657 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.634831 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.634953 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.635227 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.635374 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.635533 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.635897 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.636035 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.636163 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.636284 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.636403 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.636521 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.636653 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.636781 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.636901 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.637020 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.637172 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.637295 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.637514 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.637642 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.637853 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.637977 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.638158 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.638281 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.638498 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.638623 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.638804 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.638925 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.639110 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.639233 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.639431 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.639556 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.639738 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.639860 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.640050 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.640181 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.640352 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.640474 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.640655 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.640772 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.640956 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.641081 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.641263 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.641453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.641598 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.641732 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.641899 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.642032 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.642208 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.642332 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.642510 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.642631 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.642816 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.642949 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.643120 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.643246 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.643419 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.643528 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.643725 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.643842 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.644026 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.644150 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.644335 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.644460 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.644634 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.644767 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.644934 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.645056 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.645234 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.645376 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.645565 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.645688 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.645946 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.646078 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.646198 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.646315 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.646463 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.646587 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.646765 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.646886 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.647075 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.647198 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.647377 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.647511 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.647676 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.647797 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.647978 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.648101 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.648287 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.648411 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.648593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.648716 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.648895 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.649027 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.649199 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.649366 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.649540 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.649661 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:06:53.649845 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.649982 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.650149 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.650282 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.650460 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.650583 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.650847 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.651153 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.651404 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.651557 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.651781 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.651914 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.652112 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.652416 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.652574 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.652725 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.652904 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.653027 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.653226 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.653414 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.653574 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.653697 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.653906 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.654036 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.654222 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.654344 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.654525 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.654660 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.654868 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655000 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655134 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655255 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655419 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655582 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655739 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.655863 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.656544 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.656682 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.656802 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.656930 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657050 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657182 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657303 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657520 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657641 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657760 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.657930 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.658073 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.658289 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.658421 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.658594 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.658723 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.658907 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659039 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659225 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659357 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659537 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659661 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659847 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.659983 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.660160 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.660284 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.660461 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.660590 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.660775 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.660907 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.661084 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.661207 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.661417 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.661555 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.661724 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.661857 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662027 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662151 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662348 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662471 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662658 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662784 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.662990 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.663121 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.663280 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.663403 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.663597 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.663844 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.663976 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664104 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664224 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664408 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664530 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664650 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664808 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.664934 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.665116 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.665249 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.665447 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.665581 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.665760 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.665887 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.666071 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.666210 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.666546 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.666680 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.666800 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.666918 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.667095 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.667252 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.667407 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.667565 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.667697 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.667886 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.668009 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.668307 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.668613 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.668938 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.669249 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.669580 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.669917 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.670195 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.670508 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.670812 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.671256 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.671570 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.671888 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.672184 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.672495 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.672811 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.673128 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.673465 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.673773 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.673916 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.674222 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.674363 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.674505 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.674845 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.674978 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.675153 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.675330 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.675484 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.675690 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.675831 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.676045 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.676203 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.676366 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.676500 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.676733 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.676875 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677005 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677126 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677245 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677412 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677592 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677727 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.677896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.678016 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.678203 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.678328 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.678594 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.678727 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.678911 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679033 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679216 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679346 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679544 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679668 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679856 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.679980 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.680170 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.680296 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.680496 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.680630 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.680814 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.680939 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.681133 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.681256 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.681465 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.681590 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.681779 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.681940 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.682146 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.682278 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.682468 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.682591 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.682787 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.682911 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.683129 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.683266 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.683469 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.683592 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.683783 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.683914 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.684110 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.684245 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.684429 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.684550 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.684742 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.684867 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685047 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685253 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685419 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685550 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685671 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685790 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.685977 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.686102 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.686283 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.686407 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.686594 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.686724 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.686936 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687061 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687180 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687299 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687484 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687607 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687792 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.687924 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.688099 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.688223 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.688423 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.688555 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.688733 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.688856 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689037 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689161 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689375 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689515 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689667 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689789 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.689968 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.690100 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.690272 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.690404 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.690592 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.690715 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.690895 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691019 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691218 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691352 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691531 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691658 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691855 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.691987 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.692171 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.692302 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.692472 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.692593 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.692782 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.692903 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.693088 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.693219 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.693412 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.693537 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.693735 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.693859 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694027 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694153 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694347 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694659 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694792 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.694977 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.695100 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.695285 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.695407 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.695606 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.695729 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.695912 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.696035 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.696227 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.696351 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.696554 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.696690 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.696872 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697072 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697204 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697367 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697525 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697729 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697851 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.697971 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.698168 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.698290 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.698476 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.698613 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.698781 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.698905 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.699087 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.699210 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.699391 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.699524 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.699700 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.699823 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700000 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700123 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700301 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700433 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700602 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700726 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.700922 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701044 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701224 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701383 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701564 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701685 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701869 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.701990 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.702175 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.702301 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.702480 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.702603 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.702784 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.702906 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.703116 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.703241 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.703419 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.703539 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.703740 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.703863 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704054 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704177 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704365 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704487 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704677 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704810 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.704984 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.705107 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.705290 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.705463 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.705625 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.705761 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.705939 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706062 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706248 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706371 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706559 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706695 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706865 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.706988 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.707199 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.707326 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.707510 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.707650 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.707772 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.707892 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708138 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708259 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708392 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708514 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708678 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708801 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.708989 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.709362 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.709516 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.709639 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.709759 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.709917 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.710041 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.710264 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.710395 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.710517 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.710635 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.710825 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711053 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711184 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711317 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711439 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711559 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711708 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.711831 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712020 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712153 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712332 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712449 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712633 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712754 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.712966 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.713236 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.713468 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.713605 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.713727 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.713890 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.714102 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.714227 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.714405 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.714529 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.714725 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.714862 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.715043 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.715167 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.715403 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.715532 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.715710 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.715840 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716015 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716144 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716324 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716633 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716766 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.716944 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.717068 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.717268 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.717421 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.717589 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.717720 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.717899 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718029 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718209 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718332 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718514 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718645 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718823 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.718946 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.719134 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.719263 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.719449 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.719774 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.719903 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.720107 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.720239 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.720427 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.720545 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.720740 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.720863 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.721054 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.721176 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.721393 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.721523 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.721802 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.721924 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.722133 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.722268 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.722617 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.722751 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.722881 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.723178 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.723379 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.723504 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.723703 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.723834 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.724122 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.724428 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.724559 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.724733 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.724857 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725047 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725171 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725377 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725501 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725685 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725827 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.725993 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.726125 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.726306 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.726430 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.726607 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.726738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.726911 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.727033 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.727224 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.727605 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.727764 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.727905 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.728118 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.728436 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.728661 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.728935 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.729114 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.729394 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.729573 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.729748 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.729880 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730061 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730185 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730378 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730521 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730813 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.730987 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.731109 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.731273 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.731435 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.731610 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.731918 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.732051 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.732224 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.732356 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.732537 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.732847 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.733092 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.733216 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.733470 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.733598 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.733782 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.733906 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.734114 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.734247 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.734422 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.734553 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.734730 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.734853 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735037 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735171 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735341 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735463 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735645 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735769 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.735951 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736073 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736258 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736394 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736560 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736670 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736869 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.736989 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.737173 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.737381 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.737532 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.737747 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.737882 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.738100 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.738222 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.738405 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.738530 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.738716 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.738840 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739067 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739186 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739391 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739503 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739695 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739806 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.739998 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.740115 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.740303 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.740414 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.740616 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.740734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.740923 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741042 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741225 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741409 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741562 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741673 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741863 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.741962 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.742180 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.742272 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.742486 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.742741 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.742834 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743085 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743183 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743388 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743524 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743695 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743789 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.743995 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.744080 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.744317 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.744422 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.744690 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.744797 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.744944 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745067 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745242 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745371 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745575 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745675 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745878 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.745964 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.746182 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.746267 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.746489 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.746584 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.746808 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.746924 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.747113 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.747196 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.747415 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.747516 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.747769 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.747866 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748018 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748121 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748324 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748410 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748628 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748712 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.748934 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749017 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749232 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749348 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749558 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749644 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749861 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.749958 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.750164 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.750254 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.750464 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.750550 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.750785 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.750879 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751092 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751177 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751393 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751478 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751800 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.751998 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.752084 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.752305 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.752394 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.752620 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.752769 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.752951 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.753045 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.753264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.753385 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.753601 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.753696 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.753917 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.754028 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.754227 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.754343 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.754534 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.754662 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755424 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755572 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755655 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755741 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755828 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755908 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.755984 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756067 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756146 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756232 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756311 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756499 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756614 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756811 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.756933 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.757158 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.757299 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.757544 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.757644 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.757878 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.757975 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.758196 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.758283 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.758502 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.758594 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.758808 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.758902 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.759112 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.759198 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.759421 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.759506 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.759729 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.759889 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.760087 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.760182 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.760396 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.760480 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.760701 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.760828 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761011 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761142 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761333 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761480 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761649 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761795 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.761954 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.762106 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.762258 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.762415 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.762596 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.762726 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.762864 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763039 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763198 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763345 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763472 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763669 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763782 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.763981 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764086 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764288 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764386 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764597 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764689 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764901 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.764987 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.765211 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.765308 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.765542 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.765628 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.765867 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.765962 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.766164 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.766263 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.766493 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.766580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.766823 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.766907 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.767137 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.767224 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.767458 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.767549 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.767770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.767864 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.768083 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.768186 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.768387 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.768479 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.768707 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.768792 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.769029 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.769122 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.769413 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.769508 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.769673 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.769758 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770002 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770091 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770302 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770396 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770610 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770708 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.770919 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771011 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771221 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771305 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771524 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771618 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771826 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.771913 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.772145 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.772229 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.772448 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.772548 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.772760 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.772861 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.773084 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.773171 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.773423 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.773512 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.773753 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.773838 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.774071 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.774189 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.774382 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.774498 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.774712 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.774797 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.775024 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.775111 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.775337 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.775423 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.775698 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.775891 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.776013 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.776327 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.776476 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.776642 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.776728 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.776951 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.777036 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.777276 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.777435 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.777628 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.777720 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.777937 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778028 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778254 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778350 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778557 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778650 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778880 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.778973 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.779203 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.779290 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.779516 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.779613 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.779837 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.779928 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.780172 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.780258 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.780490 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.780581 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.780800 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.780893 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.781413 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 22:06:53.781541 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.781869 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.782174 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.782478 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.782792 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.783094 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.783397 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.783720 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.784025 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.784337 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.784647 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.784956 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.785261 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.785594 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.785917 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.786221 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.786541 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.786854 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.787179 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.787502 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.787806 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.788127 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.788439 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.788744 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.789049 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.789381 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.789725 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.790033 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.790357 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.790683 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.791012 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.791375 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.791716 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.792199 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.792516 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.792837 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.793168 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.793505 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.793809 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.794120 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.794442 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.794730 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.795034 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.795342 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.795645 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.795950 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.796252 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.796576 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.796877 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.797197 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.797531 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.797836 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.798142 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.798447 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.798786 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.799092 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.799428 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.799743 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.800064 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.800437 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.800699 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.801021 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.801358 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.801678 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.801996 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.802310 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.802624 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.802945 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.803298 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.803570 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.803883 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.804196 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.804553 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.805070 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.805422 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.805738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.806052 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.806367 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.806682 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.807060 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.807532 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.807847 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.808159 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.808507 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.809086 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.809670 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.810033 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.810419 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.810741 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.811059 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.811380 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.811690 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.812051 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.812365 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.812667 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.812979 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.813300 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.813641 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.813986 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.814299 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.814612 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.814923 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.815234 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.815544 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.815859 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.816173 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.816497 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.816828 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.817146 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.817556 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.817873 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.818188 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.818730 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.819043 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.819379 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.819703 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.820029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.820347 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.820664 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.820991 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.821295 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.821622 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.821934 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.822244 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.822551 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.822879 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.823193 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.823496 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.823814 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.824123 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.824658 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.825010 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.825352 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.825683 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.826009 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.826329 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.826637 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.826963 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.827271 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.827577 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.827892 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.828202 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.828506 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.828812 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.829121 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.829452 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.829758 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.830068 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.830370 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.830696 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.831003 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.831309 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.831619 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.831925 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.832230 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.832536 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.832835 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.833146 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.833588 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.833907 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.834210 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.834515 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.834826 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.835129 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.835439 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.835794 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.836117 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.836422 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.836727 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.837043 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.837370 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.837696 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.838008 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.838427 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.838855 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.839138 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.839620 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.839956 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.840278 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.840610 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.840940 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.841246 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.841579 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.841885 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.842212 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.842526 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.842838 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.842973 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO dbcounter [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Registered counter for database nova_api Jun 15 22:06:53.843155 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.843467 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.843775 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.844084 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.844392 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.844702 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.845011 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.845339 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.845649 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.845958 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.846265 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.846580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.846920 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.847237 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.847553 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.847869 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.848185 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.848495 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.848803 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.849111 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.849442 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.849758 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.850085 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.850397 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.850703 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.851126 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.851439 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.851758 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.852077 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.852387 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.852705 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.853033 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.853361 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.853686 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.854100 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.854430 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.854767 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.855093 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.855417 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.855724 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.856028 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.856332 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.856640 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.856959 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.857265 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.858738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.858738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.858738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.858738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.858738 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.859435 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.859435 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.859650 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.859921 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.860225 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.860526 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.860829 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.861129 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.861460 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.861767 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.862072 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.862375 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.862675 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.862984 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.863282 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.863622 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.863950 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.864260 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.864581 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.864871 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_db.sqlalchemy.engines [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:53.864979 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.865198 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.865535 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.865858 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.866177 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.866495 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.866804 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.867135 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.867445 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.867753 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.868060 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.868370 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.868680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.868989 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.869436 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.869719 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.870024 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.870348 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.870767 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.871094 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.871414 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.871726 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.871957 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writer thread running {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:53.872084 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.872355 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.872666 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.872990 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.873301 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.873638 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.873955 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.874272 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.874601 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.874926 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.875236 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.875563 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.875888 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.876238 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.876551 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.876897 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.877227 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.877568 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.877881 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.878185 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:06:53.878431 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 22:06:53.930093 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.context [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e2fb47e-e475-4f13-884d-5122f57ae4d4(cell1) {{(pid=103248) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 22:06:53.934640 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:06:53.936237 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:06:53.937052 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:06:53.939089 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:06:53.941099 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO dbcounter [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Registered counter for database nova_cell0 Jun 15 22:06:53.941256 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO dbcounter [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Registered counter for database nova_api Jun 15 22:06:53.945110 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO dbcounter [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Registered counter for database nova_cell1 Jun 15 22:06:53.953343 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_db.sqlalchemy.engines [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:53.955102 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_db.sqlalchemy.engines [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:53.961460 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writer thread running {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:53.961672 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_db.sqlalchemy.engines [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:53.962714 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writer thread running {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:53.968354 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writer thread running {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:54.031029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.context [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e2fb47e-e475-4f13-884d-5122f57ae4d4(cell1) {{(pid=103249) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 22:06:54.035583 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_concurrency.lockutils [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:06:54.037170 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_concurrency.lockutils [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:06:54.037990 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_concurrency.lockutils [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:06:54.039984 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_concurrency.lockutils [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:06:54.042116 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO dbcounter [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Registered counter for database nova_cell0 Jun 15 22:06:54.046135 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO dbcounter [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Registered counter for database nova_cell1 Jun 15 22:06:54.053712 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_db.sqlalchemy.engines [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:54.056158 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_db.sqlalchemy.engines [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:54.060792 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writer thread running {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:54.064039 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writer thread running {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:54.120681 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO dbcounter [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Registered counter for database nova_cell0 Jun 15 22:06:54.130035 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_db.sqlalchemy.engines [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:54.134898 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writer thread running {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:54.213244 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO dbcounter [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Registered counter for database nova_cell0 Jun 15 22:06:54.223933 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG oslo_db.sqlalchemy.engines [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:06:54.230332 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writer thread running {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:06:54.481422 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: WARNING keystonemiddleware.auth_token [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:06:54.488725 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: WARNING keystonemiddleware.auth_token [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:06:54.556524 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: WARNING keystonemiddleware.auth_token [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:06:54.564540 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: WARNING keystonemiddleware.auth_token [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:06:54.834655 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: WARNING keystonemiddleware.auth_token [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:06:54.840979 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: WARNING keystonemiddleware.auth_token [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:06:54.846594 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559505f699c0 pid: 103248 (default app) Jun 15 22:06:54.848803 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:06:54.850037 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001872 Jun 15 22:06:54.850456 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Wed Jun 15 22:06:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:06:54.923402 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: WARNING keystonemiddleware.auth_token [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:06:54.929487 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: WARNING keystonemiddleware.auth_token [None req-37086dd6-7092-4d09-9752-7af7de8da968 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:06:54.935947 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559505f699c0 pid: 103249 (default app) Jun 15 22:08:13.002490 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:13.003745 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jun 15 22:08:13.004394 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:13.017536 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writing DB stats nova_api:SELECT=3 {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:13.018475 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writing DB stats nova_cell0:SELECT=3 {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:13.019644 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writing DB stats nova_cell1:SELECT=3 {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:13.020523 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writing DB stats nova_cell0:SELECT=3 {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:13.490415 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-e55aa546-64ca-4d93-9780-930337eea4ea admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:13.521573 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-e55aa546-64ca-4d93-9780-930337eea4ea admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.509143 Jun 15 22:08:13.522374 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 15 22:08:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:08:15.739935 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:15.741837 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-f63c8001-0007-4ca3-88f8-c51310560056 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Jun 15 22:08:15.742578 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:15.808904 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-367161fc-dc7e-4a17-b639-0ff659998649 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:15.828679 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:08:15.828679 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: warnings.warn(msg) Jun 15 22:08:15.858601 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-367161fc-dc7e-4a17-b639-0ff659998649 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109306 Jun 15 22:08:15.859431 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:15.873368 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_api:SELECT=3 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:15.874890 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_cell0:SELECT=3 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:15.875779 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_cell1:SELECT=3 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:15.877427 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:16.096294 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-2aa0d426-3dff-449e-839e-0aad38aaf315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:16.099097 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:08:16.099097 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: warnings.warn(msg) Jun 15 22:08:16.164302 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-2aa0d426-3dff-449e-839e-0aad38aaf315 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.296291 Jun 15 22:08:16.165105 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 15 22:08:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:08:18.355436 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-367161fc-dc7e-4a17-b639-0ff659998649 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:18.356483 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-367161fc-dc7e-4a17-b639-0ff659998649 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 15 22:08:18.357305 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:18.487981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-d6a805fa-3428-424b-b5b8-a9087bc6eb74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "disk": 5}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:18.506240 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:08:18.506240 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: warnings.warn(msg) Jun 15 22:08:18.528140 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-d6a805fa-3428-424b-b5b8-a9087bc6eb74 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163210 Jun 15 22:08:18.528983 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:18.542861 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-267fec7d-f308-48df-a6e4-bc203ce271b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:18.544774 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:08:18.544774 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: warnings.warn(msg) Jun 15 22:08:18.605487 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-267fec7d-f308-48df-a6e4-bc203ce271b2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067185 Jun 15 22:08:18.605998 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 15 22:08:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:08:20.879053 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-d6a805fa-3428-424b-b5b8-a9087bc6eb74 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:20.880077 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-d6a805fa-3428-424b-b5b8-a9087bc6eb74 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 15 22:08:20.880476 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:20.952643 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-30d73f88-bd4f-4df8-aa1c-94d370e897e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:20.984704 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-30d73f88-bd4f-4df8-aa1c-94d370e897e6 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097025 Jun 15 22:08:20.985906 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:21.005722 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-10c977c8-719c-4306-bb7e-0bfc6e66b71f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:21.040680 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-10c977c8-719c-4306-bb7e-0bfc6e66b71f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041944 Jun 15 22:08:21.041587 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 15 22:08:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:08:23.271001 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-30d73f88-bd4f-4df8-aa1c-94d370e897e6 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:23.272037 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-30d73f88-bd4f-4df8-aa1c-94d370e897e6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 15 22:08:23.272425 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:23.341392 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-785930c4-ef4a-4529-92c3-aabbca3b0ef3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:23.362178 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-785930c4-ef4a-4529-92c3-aabbca3b0ef3 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083173 Jun 15 22:08:23.362648 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:23.375963 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-55f1732e-5f05-4846-abb8-3d8048d59f6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:23.404473 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-55f1732e-5f05-4846-abb8-3d8048d59f6c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032442 Jun 15 22:08:23.405084 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 15 22:08:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:08:25.642250 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-785930c4-ef4a-4529-92c3-aabbca3b0ef3 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:25.643461 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-785930c4-ef4a-4529-92c3-aabbca3b0ef3 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jun 15 22:08:25.643985 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:25.710643 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-3c0cca41-ecb2-4a4d-a3bf-eda6f85f885e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:25.730948 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-3c0cca41-ecb2-4a4d-a3bf-eda6f85f885e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080715 Jun 15 22:08:25.731512 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:25.744079 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-37f3cf8e-8aea-47e6-8bc2-f1fe885b58ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:25.769697 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-37f3cf8e-8aea-47e6-8bc2-f1fe885b58ea admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029635 Jun 15 22:08:25.770492 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 15 22:08:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:08:28.050455 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-3c0cca41-ecb2-4a4d-a3bf-eda6f85f885e admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:28.051480 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-3c0cca41-ecb2-4a4d-a3bf-eda6f85f885e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 15 22:08:28.051911 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:28.112995 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-3ab9301f-b3de-406c-8638-acc652285923 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:28.137444 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-3ab9301f-b3de-406c-8638-acc652285923 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078466 Jun 15 22:08:28.138745 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 15 22:08:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:08:30.626726 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-3c0cca41-ecb2-4a4d-a3bf-eda6f85f885e admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:30.628142 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-3c0cca41-ecb2-4a4d-a3bf-eda6f85f885e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Jun 15 22:08:30.628736 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:30.703306 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-b7e5314f-a6dc-4b32-b3ea-e8c22a5d97d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "ram": 512, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:30.726208 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-b7e5314f-a6dc-4b32-b3ea-e8c22a5d97d8 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.090141 Jun 15 22:08:30.726774 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 22:08:30.740266 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-22a0e7f4-b6db-4129-ba84-87c704cf7c64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:30.776831 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-22a0e7f4-b6db-4129-ba84-87c704cf7c64 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040604 Jun 15 22:08:30.777425 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 15 22:08:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:08:33.166497 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-b7e5314f-a6dc-4b32-b3ea-e8c22a5d97d8 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:33.167753 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-b7e5314f-a6dc-4b32-b3ea-e8c22a5d97d8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Jun 15 22:08:33.168168 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:33.254812 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-31763e3d-e527-4438-af8d-08221fa67e20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "name": "m1.small", "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:33.277375 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-31763e3d-e527-4438-af8d-08221fa67e20 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.101261 Jun 15 22:08:33.278228 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:33.296452 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-1ec88dcc-b374-4b09-8510-7f910fb65d57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:33.329293 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-1ec88dcc-b374-4b09-8510-7f910fb65d57 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038123 Jun 15 22:08:33.330469 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 15 22:08:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:08:35.949821 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-31763e3d-e527-4438-af8d-08221fa67e20 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:35.950855 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-31763e3d-e527-4438-af8d-08221fa67e20 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jun 15 22:08:35.951267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:36.010646 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-18081ea4-fb23-4eab-8f89-607c78ee66fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "disk": 40, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:36.029413 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-18081ea4-fb23-4eab-8f89-607c78ee66fe admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072063 Jun 15 22:08:36.030020 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 22:08:36.042607 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-15cb05d6-73aa-4769-8391-babebce74c98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:36.067251 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-15cb05d6-73aa-4769-8391-babebce74c98 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028497 Jun 15 22:08:36.068054 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 15 22:08:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:08:38.273347 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-18081ea4-fb23-4eab-8f89-607c78ee66fe admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:38.274445 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-18081ea4-fb23-4eab-8f89-607c78ee66fe admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jun 15 22:08:38.274827 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:38.335260 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-8df058ae-9b78-4482-8282-b2177b1e48b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:38.353595 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-8df058ae-9b78-4482-8282-b2177b1e48b3 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072311 Jun 15 22:08:38.354193 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:38.366741 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-04672526-5af6-464a-bcff-532b85feed2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:38.391260 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-04672526-5af6-464a-bcff-532b85feed2c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028285 Jun 15 22:08:38.391859 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 15 22:08:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:08:40.659995 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-8df058ae-9b78-4482-8282-b2177b1e48b3 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:08:40.661067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-8df058ae-9b78-4482-8282-b2177b1e48b3 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 15 22:08:40.661707 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:08:40.727158 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-9778cb14-b28a-4495-8e12-0c25b85b2b3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "disk": 160}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:40.747131 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-9778cb14-b28a-4495-8e12-0c25b85b2b3a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077728 Jun 15 22:08:40.747973 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 15 22:08:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:08:40.762713 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-ea11bae6-b5bd-4024-8547-d6c3cdba4cea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:08:40.792833 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-ea11bae6-b5bd-4024-8547-d6c3cdba4cea admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036470 Jun 15 22:08:40.793638 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 15 22:08:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:09:04.212867 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-9778cb14-b28a-4495-8e12-0c25b85b2b3a admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:04.214137 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-9778cb14-b28a-4495-8e12-0c25b85b2b3a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 15 22:09:04.214560 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:09:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:04.225556 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:04.286837 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-93ff708e-6caf-40aa-bcbc-009fb4f20c70 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:04.304429 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-93ff708e-6caf-40aa-bcbc-009fb4f20c70 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083646 Jun 15 22:09:04.304964 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 15 22:09:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:05.298190 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-9778cb14-b28a-4495-8e12-0c25b85b2b3a admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:05.299205 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-9778cb14-b28a-4495-8e12-0c25b85b2b3a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 15 22:09:05.299604 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:05.497484 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-19068ef5-6d2e-4cfb-842c-a54874e014a3 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:05.503331 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.wsgi [None req-19068ef5-6d2e-4cfb-842c-a54874e014a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-19068ef5-6d2e-4cfb-842c-a54874e014a3 admin admin] Request method failure captured: Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Accept: application/json Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Accept-Encoding: gzip, deflate Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Connection: keep-alive Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Content-Length: 0 Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Host: 10.222.0.55 Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Openstack-Api-Version: compute 2.90 Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Openstack-System-Scope: None Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: User-Agent: python-novaclient Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Auth-Token: gAAAAABiqliBZFKmMGi2GpaMJJi-oWhyUNHqRCz8NDF_zzCnmK2RFTdSiykuKidtrNUHTtmOQzTPsFqvS7kWz5rnoKP3NEDroxT-VTWZAotLAcvqEeIIgiYOWe7FXgCj9zp40b2j5K8PU3_zZ2PA-orv-7Z9jXQW40a1ljaUbT7rXjGx-LAb9MA Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Domain-Id: None Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Domain-Name: None Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Identity-Status: Confirmed Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Is-Admin-Project: True Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Domain-Id: default Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Domain-Name: Default Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Name: admin Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Role: admin,member,reader Jun 15 22:09:05.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Roles: admin,member,reader Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_adfb054cdc38413f9503cf43dad1c55e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant: admin Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant-Name: admin Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User: admin Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Domain-Id: default Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Domain-Name: Default Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Id: 2163e83cb8fa4cdb98d8294e2a7f2e22 Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Name: admin Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: method: > Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: exception: Flavor 42 could not be found. Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: action_args: {'id': '42'} Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:09:05.508040 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:05.508900 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.510029 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-19068ef5-6d2e-4cfb-842c-a54874e014a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:09:05.511905 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-19068ef5-6d2e-4cfb-842c-a54874e014a3 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070688 Jun 15 22:09:05.511905 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 15 22:09:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:05.518124 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-ca85c4dd-0e6c-4d00-b5a5-9a43d6db68d0 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:05.521117 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:05.542093 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-ca85c4dd-0e6c-4d00-b5a5-9a43d6db68d0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027179 Jun 15 22:09:05.543113 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 15 22:09:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:05.553163 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-9f5612a6-1321-494f-8de2-76416b1d08b5 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:05.575176 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-9f5612a6-1321-494f-8de2-76416b1d08b5 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025656 Jun 15 22:09:05.575745 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 15 22:09:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:05.585837 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-b54321e9-e4c8-40ce-89e2-49f6bb0c026e admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:05.591977 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.wsgi [None req-b54321e9-e4c8-40ce-89e2-49f6bb0c026e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-b54321e9-e4c8-40ce-89e2-49f6bb0c026e admin admin] Request method failure captured: Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Accept: application/json Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Accept-Encoding: gzip, deflate Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Connection: keep-alive Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Content-Length: 0 Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Host: 10.222.0.55 Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Openstack-Api-Version: compute 2.90 Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Openstack-System-Scope: None Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: User-Agent: python-novaclient Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Auth-Token: gAAAAABiqliBZFKmMGi2GpaMJJi-oWhyUNHqRCz8NDF_zzCnmK2RFTdSiykuKidtrNUHTtmOQzTPsFqvS7kWz5rnoKP3NEDroxT-VTWZAotLAcvqEeIIgiYOWe7FXgCj9zp40b2j5K8PU3_zZ2PA-orv-7Z9jXQW40a1ljaUbT7rXjGx-LAb9MA Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Domain-Id: None Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Domain-Name: None Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Identity-Status: Confirmed Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Is-Admin-Project: True Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Domain-Id: default Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Domain-Name: Default Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Name: admin Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Role: admin,member,reader Jun 15 22:09:05.595314 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Roles: admin,member,reader Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_adfb054cdc38413f9503cf43dad1c55e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant: admin Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant-Name: admin Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User: admin Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Domain-Id: default Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Domain-Name: Default Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Id: 2163e83cb8fa4cdb98d8294e2a7f2e22 Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Name: admin Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: method: > Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: exception: Flavor 42 could not be found. Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: action_args: {'id': '42'} Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:09:05.596593 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:05.597483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:05.598483 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-b54321e9-e4c8-40ce-89e2-49f6bb0c026e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:09:05.599741 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-b54321e9-e4c8-40ce-89e2-49f6bb0c026e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014859 Jun 15 22:09:05.599741 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 15 22:09:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 22:09:06.484777 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-9f5612a6-1321-494f-8de2-76416b1d08b5 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:06.485919 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-9f5612a6-1321-494f-8de2-76416b1d08b5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jun 15 22:09:06.486261 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:06.697352 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-187fef4b-2596-4821-a127-268a92a7a0a3 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:06.703909 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.wsgi [None req-187fef4b-2596-4821-a127-268a92a7a0a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-187fef4b-2596-4821-a127-268a92a7a0a3 admin admin] Request method failure captured: Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Accept: application/json Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Accept-Encoding: gzip, deflate Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Connection: keep-alive Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Content-Length: 0 Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Host: 10.222.0.55 Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Openstack-Api-Version: compute 2.90 Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Openstack-System-Scope: None Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: User-Agent: python-novaclient Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Auth-Token: gAAAAABiqliCFqWeZgSLgJHeqiBuS1O41mLXIM1iW7qq1C1N8mmqV6qYaIaZQzZOr-ap_DxuGDE9KOxvCRVHALOb8U35BWl4Bxk_Zps8e9YwMrR0nDog2IdWeJpqdLoL6COflgIv_rTGS7SN-BBUY8PlPbkuJjftMBXdhkuDSPdXEwzOpAb5yy8 Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Domain-Id: None Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Domain-Name: None Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Identity-Status: Confirmed Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Is-Admin-Project: True Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Domain-Id: default Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Domain-Name: Default Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Name: admin Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Role: admin,member,reader Jun 15 22:09:06.705446 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Roles: admin,member,reader Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_adfb054cdc38413f9503cf43dad1c55e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant: admin Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant-Name: admin Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User: admin Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Domain-Id: default Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Domain-Name: Default Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Id: 2163e83cb8fa4cdb98d8294e2a7f2e22 Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Name: admin Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: method: > Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: exception: Flavor 84 could not be found. Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: action_args: {'id': '84'} Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:09:06.706896 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:06.707734 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.708981 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-187fef4b-2596-4821-a127-268a92a7a0a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:09:06.710306 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-187fef4b-2596-4821-a127-268a92a7a0a3 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076907 Jun 15 22:09:06.710306 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 15 22:09:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:06.717459 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-a090a05d-9507-46c9-9a42-c4d6585c94e8 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:06.732049 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-a090a05d-9507-46c9-9a42-c4d6585c94e8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018885 Jun 15 22:09:06.732571 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 15 22:09:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:06.742432 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-49df63a5-df7a-42b6-8ac6-d285e93f7123 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:06.757881 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-49df63a5-df7a-42b6-8ac6-d285e93f7123 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019104 Jun 15 22:09:06.758434 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 15 22:09:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:06.768255 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-8fac08d4-5d76-4378-a191-f029da7f2872 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:06.773961 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.wsgi [None req-8fac08d4-5d76-4378-a191-f029da7f2872 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-8fac08d4-5d76-4378-a191-f029da7f2872 admin admin] Request method failure captured: Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Accept: application/json Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Accept-Encoding: gzip, deflate Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Connection: keep-alive Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Content-Length: 0 Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Host: 10.222.0.55 Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Openstack-Api-Version: compute 2.90 Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Openstack-System-Scope: None Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: User-Agent: python-novaclient Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Auth-Token: gAAAAABiqliCFqWeZgSLgJHeqiBuS1O41mLXIM1iW7qq1C1N8mmqV6qYaIaZQzZOr-ap_DxuGDE9KOxvCRVHALOb8U35BWl4Bxk_Zps8e9YwMrR0nDog2IdWeJpqdLoL6COflgIv_rTGS7SN-BBUY8PlPbkuJjftMBXdhkuDSPdXEwzOpAb5yy8 Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Domain-Id: None Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Domain-Name: None Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Identity-Status: Confirmed Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Is-Admin-Project: True Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Domain-Id: default Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Domain-Name: Default Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Name: admin Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Role: admin,member,reader Jun 15 22:09:06.775453 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Roles: admin,member,reader Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_adfb054cdc38413f9503cf43dad1c55e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant: admin Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant-Name: admin Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User: admin Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Domain-Id: default Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Domain-Name: Default Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Id: 2163e83cb8fa4cdb98d8294e2a7f2e22 Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Name: admin Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: method: > Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: exception: Flavor 84 could not be found. Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: action_args: {'id': '84'} Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:09:06.777067 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:06.778023 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:06.779267 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-8fac08d4-5d76-4378-a191-f029da7f2872 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:09:06.780461 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-8fac08d4-5d76-4378-a191-f029da7f2872 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012937 Jun 15 22:09:06.780461 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 15 22:09:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:07.656249 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-49df63a5-df7a-42b6-8ac6-d285e93f7123 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:07.657662 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-49df63a5-df7a-42b6-8ac6-d285e93f7123 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Jun 15 22:09:07.658075 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:07.859274 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-4f0f2789-7856-4caf-8308-580d89c580e6 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:07.867054 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.wsgi [None req-4f0f2789-7856-4caf-8308-580d89c580e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-4f0f2789-7856-4caf-8308-580d89c580e6 admin admin] Request method failure captured: Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Accept: application/json Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Accept-Encoding: gzip, deflate Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Connection: keep-alive Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Content-Length: 0 Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Host: 10.222.0.55 Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Openstack-Api-Version: compute 2.90 Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Openstack-System-Scope: None Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: User-Agent: python-novaclient Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Auth-Token: gAAAAABiqliDrofDTFixoY0kQin_GXCoBzzfYLfNapNaRuk70UjI5bUh7yMRqEI7UstPHto8JRkL220GNtEXVIP9HQPyUkGXZO7F6TjA8dBQyVTsYH3_O0khF0NjrwMY0kKcsiuT_fLk4mOM2WBhPhRVAj9Mno-WyhsK60QdshKa_vQwhfrCh48 Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Domain-Id: None Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Domain-Name: None Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Identity-Status: Confirmed Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Is-Admin-Project: True Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Domain-Id: default Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Domain-Name: Default Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Project-Name: admin Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Role: admin,member,reader Jun 15 22:09:07.868580 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Roles: admin,member,reader Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_adfb054cdc38413f9503cf43dad1c55e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant: admin Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-Tenant-Name: admin Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User: admin Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Domain-Id: default Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Domain-Name: Default Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Id: 2163e83cb8fa4cdb98d8294e2a7f2e22 Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: X-User-Name: admin Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: method: > Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: exception: Flavor 451 could not be found. Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: action_args: {'id': '451'} Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:09:07.870166 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:07.871250 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.873353 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-4f0f2789-7856-4caf-8308-580d89c580e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:09:07.874999 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-4f0f2789-7856-4caf-8308-580d89c580e6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071585 Jun 15 22:09:07.874999 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 15 22:09:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:07.884424 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-eb72218c-24f9-4df3-98c3-0aebf560fd1e admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:07.900145 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-eb72218c-24f9-4df3-98c3-0aebf560fd1e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021497 Jun 15 22:09:07.900690 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 15 22:09:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:07.910859 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:07.924786 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018019 Jun 15 22:09:07.925313 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 15 22:09:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:09:07.934654 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-a964ce8b-83f9-417a-8541-e1bb1239c54c admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:07.940239 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.wsgi [None req-a964ce8b-83f9-417a-8541-e1bb1239c54c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-a964ce8b-83f9-417a-8541-e1bb1239c54c admin admin] Request method failure captured: Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Accept: application/json Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Accept-Encoding: gzip, deflate Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Connection: keep-alive Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Content-Length: 0 Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Host: 10.222.0.55 Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Openstack-Api-Version: compute 2.90 Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Openstack-System-Scope: None Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: User-Agent: python-novaclient Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Auth-Token: gAAAAABiqliDrofDTFixoY0kQin_GXCoBzzfYLfNapNaRuk70UjI5bUh7yMRqEI7UstPHto8JRkL220GNtEXVIP9HQPyUkGXZO7F6TjA8dBQyVTsYH3_O0khF0NjrwMY0kKcsiuT_fLk4mOM2WBhPhRVAj9Mno-WyhsK60QdshKa_vQwhfrCh48 Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Domain-Id: None Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Domain-Name: None Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Identity-Status: Confirmed Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Is-Admin-Project: True Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Domain-Id: default Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Domain-Name: Default Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Project-Name: admin Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Role: admin,member,reader Jun 15 22:09:07.941770 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Roles: admin,member,reader Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/adfb054cdc38413f9503cf43dad1c55e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_adfb054cdc38413f9503cf43dad1c55e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant: admin Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant-Id: adfb054cdc38413f9503cf43dad1c55e Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-Tenant-Name: admin Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User: admin Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Domain-Id: default Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Domain-Name: Default Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Id: 2163e83cb8fa4cdb98d8294e2a7f2e22 Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: X-User-Name: admin Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: method: > Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: exception: Flavor 451 could not be found. Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: action_args: {'id': '451'} Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:09:07.943191 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:07.944264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: ERROR nova.api.openstack.wsgi Jun 15 22:09:07.946150 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-a964ce8b-83f9-417a-8541-e1bb1239c54c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:09:07.948355 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-a964ce8b-83f9-417a-8541-e1bb1239c54c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012070 Jun 15 22:09:07.948355 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 15 22:09:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:08.830254 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:08.831429 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jun 15 22:09:08.832124 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:09.031574 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-393a591f-9ded-40a6-b050-044b80a5d84a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:09:09.051984 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-393a591f-9ded-40a6-b050-044b80a5d84a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.079467 Jun 15 22:09:09.052442 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 15 22:09:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:09:09.939147 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:09.940179 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 15 22:09:09.940568 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:10.147320 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-d3a22339-6fad-43e4-beac-f60dec121b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:09:10.169757 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-d3a22339-6fad-43e4-beac-f60dec121b35 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.091163 Jun 15 22:09:10.170302 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 15 22:09:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:09:11.040791 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:11.041964 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 15 22:09:11.042357 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:11.243437 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-63d2aa0d-5013-45db-a0f2-4dcb955f2629 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:09:11.269023 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-63d2aa0d-5013-45db-a0f2-4dcb955f2629 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085285 Jun 15 22:09:11.269765 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 15 22:09:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:09:12.168055 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:12.169115 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 15 22:09:12.169540 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:12.386552 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-917c0b20-1bfa-4c75-b1d6-c3a629964ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:09:12.407287 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-917c0b20-1bfa-4c75-b1d6-c3a629964ecc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.088107 Jun 15 22:09:12.407839 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 15 22:09:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:09:13.281212 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:13.282627 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Jun 15 22:09:13.283048 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:09:13.492244 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-b0c8be3e-5b56-4dbb-bbf9-a3e11256f38e admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:09:13.512203 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-b0c8be3e-5b56-4dbb-bbf9-a3e11256f38e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.090732 Jun 15 22:09:13.512750 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Wed Jun 15 22:09:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:10:02.778324 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-c0100281-3294-489d-a919-19253744de65 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:10:02.779395 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-c0100281-3294-489d-a919-19253744de65 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 15 22:10:02.779889 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 15 22:10:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:10:02.791402 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:10:02.844174 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-7f82ea49-9535-493b-857b-e010a7e9fb4f admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:10:02.864123 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-7f82ea49-9535-493b-857b-e010a7e9fb4f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077804 Jun 15 22:10:02.864656 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 15 22:10:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:10:02.890686 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-66edf8ed-f51a-4ea3-a545-8cdd9ce32623 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:10:02.896210 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG dbcounter [-] [103249] Writing DB stats nova_api:SELECT=14 {{(pid=103249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:10:02.904479 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-66edf8ed-f51a-4ea3-a545-8cdd9ce32623 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019749 Jun 15 22:10:02.905335 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Jun 15 22:10:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:10:02.923212 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-0210ffc7-4c03-4018-86ed-3814afd2245a admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:10:02.935057 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-0210ffc7-4c03-4018-86ed-3814afd2245a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017107 Jun 15 22:10:02.936331 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Jun 15 22:10:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:10:02.951519 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:10:02.965756 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020558 Jun 15 22:10:02.966529 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Jun 15 22:10:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:10:02.985975 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-795d0564-db45-41c4-b46a-e36cd9db436f admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:10:02.998522 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-795d0564-db45-41c4-b46a-e36cd9db436f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018723 Jun 15 22:10:02.999264 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Jun 15 22:10:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:13:20.981083 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:20.982256 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 Jun 15 22:13:20.982760 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:13:21.155421 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_api:SELECT=6 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:21.341359 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-cf49063a-ec80-4c81-8490-662c86eafb7f admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:21.342553 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:13:21.342553 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: warnings.warn(msg) Jun 15 22:13:21.343838 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-cf49063a-ec80-4c81-8490-662c86eafb7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:21.344280 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-cf49063a-ec80-4c81-8490-662c86eafb7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:21.345072 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-cf49063a-ec80-4c81-8490-662c86eafb7f admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:21.345644 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-cf49063a-ec80-4c81-8490-662c86eafb7f admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:21.384175 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-cf49063a-ec80-4c81-8490-662c86eafb7f admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.230441 Jun 15 22:13:21.384813 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 15 22:13:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:13:22.362583 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:22.364394 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jun 15 22:13:22.365136 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:13:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:13:22.572377 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-bac87546-cc28-4c34-ae2a-338e4a6ffbff admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:22.573739 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:13:22.573739 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: warnings.warn(msg) Jun 15 22:13:22.575155 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-bac87546-cc28-4c34-ae2a-338e4a6ffbff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:22.575606 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-bac87546-cc28-4c34-ae2a-338e4a6ffbff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:22.576494 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-bac87546-cc28-4c34-ae2a-338e4a6ffbff admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:22.576931 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-bac87546-cc28-4c34-ae2a-338e4a6ffbff admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:22.599462 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-bac87546-cc28-4c34-ae2a-338e4a6ffbff admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086800 Jun 15 22:13:22.600080 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 15 22:13:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:13:33.968152 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:33.969172 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 15 22:13:33.969613 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:13:34.132885 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_cell0:SELECT=4 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:34.133763 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_cell1:SELECT=4 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:34.134372 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG dbcounter [-] [103248] Writing DB stats nova_api:SELECT=8 {{(pid=103248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:34.208912 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-e91c168e-af6a-4979-b502-171c022308bb admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:34.210243 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:13:34.210243 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: warnings.warn(msg) Jun 15 22:13:34.211510 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-e91c168e-af6a-4979-b502-171c022308bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:34.211959 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-e91c168e-af6a-4979-b502-171c022308bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:34.212754 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-e91c168e-af6a-4979-b502-171c022308bb admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:34.213231 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-e91c168e-af6a-4979-b502-171c022308bb admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:34.244927 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-e91c168e-af6a-4979-b502-171c022308bb admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.117210 Jun 15 22:13:34.245540 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 15 22:13:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:13:35.173375 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: DEBUG nova.api.openstack.wsgi [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] Calling method '>' {{(pid=103249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:35.174434 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: INFO nova.api.openstack.requestlog [None req-a4f7fc4f-2606-4835-a58c-204d2de3fd45 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 15 22:13:35.174836 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: [pid: 103249|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 15 22:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:13:35.374687 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG nova.api.openstack.wsgi [None req-aad6b957-61dd-4c8b-ae7d-c28a6642b858 admin admin] Calling method '>' {{(pid=103248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:13:35.375861 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:13:35.375861 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: warnings.warn(msg) Jun 15 22:13:35.377187 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-aad6b957-61dd-4c8b-ae7d-c28a6642b858 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:35.377569 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-aad6b957-61dd-4c8b-ae7d-c28a6642b858 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:35.378351 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-aad6b957-61dd-4c8b-ae7d-c28a6642b858 admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:13:35.378881 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: DEBUG oslo_concurrency.lockutils [None req-aad6b957-61dd-4c8b-ae7d-c28a6642b858 admin admin] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:13:35.402498 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: INFO nova.api.openstack.requestlog [None req-aad6b957-61dd-4c8b-ae7d-c28a6642b858 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087584 Jun 15 22:13:35.403169 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: [pid: 103248|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 15 22:13:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:14:33.151069 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: Wed Jun 15 22:14:33 2022 - graceful shutdown triggered... Jun 15 22:14:33.150743 dv-cinder-835384-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 22:14:33.152087 dv-cinder-835384-7-iscsi devstack@n-api.service[103249]: Gracefully killing worker 2 (pid: 103249)... Jun 15 22:14:33.152455 dv-cinder-835384-7-iscsi devstack@n-api.service[103248]: Gracefully killing worker 1 (pid: 103248)... Jun 15 22:14:34.151880 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: worker 1 buried after 1 seconds Jun 15 22:14:34.151880 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: worker 2 buried after 1 seconds Jun 15 22:14:34.151880 dv-cinder-835384-7-iscsi devstack@n-api.service[103247]: goodbye to uWSGI. Jun 15 22:14:34.153735 dv-cinder-835384-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 22:14:34.154328 dv-cinder-835384-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 22:14:34.157579 dv-cinder-835384-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 22:14:34.172716 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 22:14:34.175866 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 22:14:34 2022] *** Jun 15 22:14:34.176513 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 22:14:34.176717 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 22:14:34.176890 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: nodename: dv-cinder-835384-7-iscsi Jun 15 22:14:34.177085 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: machine: x86_64 Jun 15 22:14:34.177253 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: clock source: unix Jun 15 22:14:34.177449 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: pcre jit disabled Jun 15 22:14:34.177628 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: detected number of CPU cores: 4 Jun 15 22:14:34.177867 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: current working directory: / Jun 15 22:14:34.177867 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: detected binary path: /usr/bin/uwsgi-core Jun 15 22:14:34.177867 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: your processes number limit is 47680 Jun 15 22:14:34.177867 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: your memory page size is 4096 bytes Jun 15 22:14:34.177867 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: detected max file descriptor number: 2048 Jun 15 22:14:34.177867 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: lock engine: pthread robust mutexes Jun 15 22:14:34.178305 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: thunder lock: enabled Jun 15 22:14:34.178405 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 22:14:34.178515 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 22:14:34.225202 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: Python main interpreter initialized at 0x55e39aabe9c0 Jun 15 22:14:34.225202 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: python threads support enabled Jun 15 22:14:34.225202 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: your server socket listen backlog is limited to 100 connections Jun 15 22:14:34.225202 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: your mercy for graceful operations on workers is 90 seconds Jun 15 22:14:34.225951 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 22:14:34.225951 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: *** Operational MODE: preforking *** Jun 15 22:14:34.231052 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: *** uWSGI is running in multiple interpreter mode *** Jun 15 22:14:34.231052 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: spawned uWSGI master process (pid: 117616) Jun 15 22:14:34.231052 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: spawned uWSGI worker 1 (pid: 117629, cores: 1) Jun 15 22:14:34.231052 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: spawned uWSGI worker 2 (pid: 117630, cores: 1) Jun 15 22:14:34.231052 dv-cinder-835384-7-iscsi devstack@n-api.service[117616]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 22:14:34.226269 dv-cinder-835384-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 22:14:34.923630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 22:14:35.000859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 22:14:36.216137 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:14:36.216137 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: from cryptography.utils import int_from_bytes Jun 15 22:14:36.217382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:14:36.217382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: from cryptography.utils import int_from_bytes Jun 15 22:14:36.687930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:14:36.687930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: from cryptography.utils import int_from_bytes Jun 15 22:14:36.688671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:14:36.688671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: from cryptography.utils import int_from_bytes Jun 15 22:14:39.405076 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 22:14:39.406331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 22:14:39.406331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 22:14:39.406331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 22:14:39.406747 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 22:14:39.406901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.407414 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.407601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.408386 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.408555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.408816 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.409135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.409590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.409908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.410168 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-7-iscsi {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.415047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.418253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.418253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.418253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.418253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.418253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.418253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-7-iscsi {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.420259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.422691 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 22:14:39.423971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.424270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 22:14:39.424757 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.425983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 22:14:39.426271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.426500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 22:14:39.426732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.427037 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 22:14:39.427292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.427562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.427789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.428005 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.429509 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.429736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.429935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.430190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.430429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.430682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.430906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.431136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.431379 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.431610 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.431829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.431829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.432339 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.432591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.432827 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.433031 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.433242 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.433548 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.435494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.435787 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.436035 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-7-iscsi {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.436245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.436245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.436743 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.436961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.437173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.437584 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.437838 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.438069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.438277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.438277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.438786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.438786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.439209 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.439428 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.439704 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.439954 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.439954 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.440355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.440594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.441013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.444130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.444491 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.444761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.445010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.445292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.445604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.445867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.446106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.446357 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.446622 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.446884 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.447138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.447138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.447613 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.447872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.448120 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.448343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.448575 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.448575 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.449034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-7-iscsi {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.449265 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.449590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.449818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.450060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.450060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.450532 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.450532 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.450996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.450996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.451490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.453544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.453866 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.454102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.454313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.454550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.454779 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.454977 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.455218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.455457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.455664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.455869 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.456060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.456370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.456650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.456858 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.457057 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.457249 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.457501 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.457694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.457895 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.458118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.459438 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.459690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.459917 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.460155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.460390 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.460632 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.460864 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.461087 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.461365 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.461616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.461869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.462131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.462364 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.462590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.462972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.463244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.464048 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.464309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.464309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.464756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.464756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.465150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.465410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.465671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.465896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.466102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.466391 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.466630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.466867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.467101 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.467303 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.467528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.467782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.468014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.468223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.468457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.468457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.469269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.469269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.469269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.469958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.470205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.470455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.470694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.470930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.471159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.471393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.471612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.471814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.472062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.472261 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.472471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.472687 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.472895 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.473376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.473711 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.474564 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.474798 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.475051 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.475290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.475527 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.475758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.475984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.476189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.476400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.476590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.476817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.477068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.477294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.477685 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.477938 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.478169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.478402 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.478625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.478892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.479302 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.479302 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.479761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.480002 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.480250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.480250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.481762 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.482000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.482234 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.482482 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.482728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.482966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.483214 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.483604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.483827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.483827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.484911 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.485153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.485448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.485448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.485911 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.486155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.486596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.486851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.487735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.488058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.488297 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.488653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.488921 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.489179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.491577 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.491893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.492127 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.492372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.492601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.492852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.493067 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.493298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.493626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.494033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.494299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.495238 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.495473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.495721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.495952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.496179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.496430 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.496674 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.496921 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.497165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.497438 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.497680 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.497901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.498121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.498368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.498607 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.498607 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.499061 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.499307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.499528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.499747 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.500026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.500026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.500623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.500848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.500848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.501294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.501294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.501849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.501849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.502298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.502298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.502760 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.502988 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.503744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.504019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.504456 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.504707 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.505611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.505850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.506098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.506375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.506612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.506851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.507120 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.508251 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.508591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.508802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.509010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.509223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.509456 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.509655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.509852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.510066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.510309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.510708 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.510924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.511148 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.511383 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.511614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.511830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.512068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.512313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.512537 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.512760 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.512984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:14:39.513207 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.513525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.513780 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.514005 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.514241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.514499 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.514910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.515811 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.516060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.516293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.516534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.516771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.517000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.517262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.517534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.517698 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.517915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.518074 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.518217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.518375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.518533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.518676 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.518847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519030 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.519998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520669 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520794 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.520936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521491 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521640 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.521900 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522501 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522804 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.522947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.523094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.523241 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.523511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.523511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.523511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.523900 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524584 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.524921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.525082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.525298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.525490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.525997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.526156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.526310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.526498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.526661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.526810 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.526954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.527986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.528138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.528294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.528636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.528786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.528941 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.529099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.529261 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.529450 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.529606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.529756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.529899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530184 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530315 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530443 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.530922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.531347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.531619 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.531870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.532110 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.532285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.532439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.532609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.532784 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.532974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.533586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.533755 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.533930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534782 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.534936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.535089 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.535251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.535251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.535518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.535653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.535797 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.536265 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.536401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.536401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.536645 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.536823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.536981 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.537137 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.537295 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.537463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.537646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.537802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.537968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.538106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.538290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.538504 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.538668 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.538820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.538969 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.539133 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.539290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.539444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.539608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.539764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.539930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540089 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540247 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540595 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540733 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.540855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.541088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.541229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.541229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.541588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.541743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.541898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542034 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542641 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542810 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.542989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.543164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.543333 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.543501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.543661 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.543809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544003 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544464 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544728 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.544852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545210 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545609 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545860 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.545989 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.546168 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.546641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.546783 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.546917 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547064 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547207 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.547776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548234 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548687 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.548971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.549112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.549252 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.549439 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.549592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.549740 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.549889 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.550204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.550351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.550498 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.550654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.550813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.550958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551095 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551219 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551341 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551779 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.551940 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552102 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552819 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.552942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.553108 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.553251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.553477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.553632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.553801 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.553967 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.554225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.554376 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.554547 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.554700 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.554833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.554958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.555100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.555258 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.555388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.555529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.555669 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.555811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.556179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.556859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.557766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.557931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.558099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.558255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.558255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.558556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.558722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.558882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559621 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559745 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.559988 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560222 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.560904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561017 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561235 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561589 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561737 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.561894 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.562056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.562224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.562394 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.562552 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.562781 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563002 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563297 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563609 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.563865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564001 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564468 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564596 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564733 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.564887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.565030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.565201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.565386 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.565550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.565823 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.565975 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.566174 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.566322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.566322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.566635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.566974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.567122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.567286 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.567432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.567576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.567731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.567888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.568043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.568205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.568348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.568495 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.568660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.569204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.569204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.569593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.569749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.569926 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570234 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570368 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570745 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.570883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.571047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.571406 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.571534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.571670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.571821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.571966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572131 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.572913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.574198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.575970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.577019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.578388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.579367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.580350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.582085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.583220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.584176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.585159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.586321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.587525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.588618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.590239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.591422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.592548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.593554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.594588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.595650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.598106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.600477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.601877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.603396 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.603569 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.603569 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.603868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.604552 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.604552 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.604552 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.605113 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.605534 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.605534 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.605534 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.605996 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.606153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.607103 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.607234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.607366 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.607488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.607488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608369 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608707 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608799 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.608887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609367 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609480 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609575 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.609904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610054 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610123 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610123 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610332 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610332 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.610754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.611216 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.611287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.611287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.611725 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.611920 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.612223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.612373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.612507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.613139 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.613281 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.613488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.613640 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.614295 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.614443 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.614576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.614722 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.614869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.614869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.615124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.615241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.615918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.616069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.616221 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.616364 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.616490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.616983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.617130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.617130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.617409 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.617847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.618107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.618349 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.618587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.618837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.619069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.619069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.619547 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.619785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.619785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.620252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.620510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.620510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.620950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.621194 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.621495 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.621726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.621726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.622175 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.622413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.622413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.622871 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.623117 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.623377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.623617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.623861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.623861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.624326 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.624565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.624565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.625018 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.625256 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.625517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.625764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.626004 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.626242 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.626514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.626514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.626971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.627224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.627224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.627676 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.627918 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.627918 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629783 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.629999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.630942 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.631177 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.631425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.631425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.631885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.632131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.632131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.632587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.632838 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.633104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.633405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.633660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.633660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.634113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.634353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.634597 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.634829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.634829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.635624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.635869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.635869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.636320 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.636569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.636569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.637041 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.637288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.637590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.637811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.637811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.638275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.638527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.638527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.639102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.639102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.639544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.639796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.640020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.640270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.640270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.640736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.640955 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.641196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.641196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.641196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.641196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.641196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.642437 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.642669 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.642669 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.643156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.643398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.643398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.643924 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.644159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.644159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.644650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.644897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.644897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.644897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.645707 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.645959 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.645959 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.646453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.646701 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.646947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.647196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.647196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.647671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.647917 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.648149 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.648378 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.648623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.648873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.649091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.649400 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.649656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.649905 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.650157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.650157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.650608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.650854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.651102 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.651337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.651593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.651843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.652091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.652091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.652574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.652812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.653068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.653313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.653589 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.653818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.654061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.654309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.654542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.654771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.654771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.654771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.655460 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.655712 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.655962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.656201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.656201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.656641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.656889 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.657134 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.657426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.657681 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.657900 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.658519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.658761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.658995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.659212 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.659485 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.659485 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.659942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.660200 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.660446 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.660688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.660908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.661140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.661411 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.661685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.661937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.662169 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.662402 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.662640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.662872 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.663104 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.663323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.663547 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.663797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.664027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.664275 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.664519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.664751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.664996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.665233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.665550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.665805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.665805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.666263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.666508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.666739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.666989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.667246 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.667490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.667760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.667997 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.668228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.668489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.668724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.668963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.668963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.668963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.669682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.669947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.669947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.669947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.670670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.670927 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.671170 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.671427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.671666 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.671905 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.672156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.672421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.672675 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.672930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.673172 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.673514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.673779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.674021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.674302 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.674557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.674795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.675071 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.675412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.675676 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.675940 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.676194 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.676446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.676676 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.676910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.677152 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.677444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.677702 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.677937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.678193 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.678193 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.678684 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.678923 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.679163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.679411 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.679659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.679902 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.680151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.680381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.680620 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.680867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.681120 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.681429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.681702 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.681942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.682224 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.682468 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.682719 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.682951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.683209 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.683444 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.683679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.683947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.683947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.683947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.684772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.685009 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.685251 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.685513 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.685738 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.685993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.685993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.686463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.686692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.686937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.687173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.687427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.687680 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.687914 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.688142 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.688362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.688569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.688807 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.689025 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.689253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.689534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.689759 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.690022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.690255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.690487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.690912 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.691171 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.691435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.691705 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.691953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.692185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.692408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.692647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.692884 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.693139 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.693448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.693688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.693946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.693946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.694408 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.694661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.694899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.695131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.695359 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.695605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.695857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.696108 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.696353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.696600 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.696820 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.697059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.697309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.697570 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.697828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.698050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.698262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.698480 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.698735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.698957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.699179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.699179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.699179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.699179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.700070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.700279 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.700279 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.700668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.700890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.701137 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.701441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.701673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.701901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.702140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.702387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.702625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.702842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.703054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.703265 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.703505 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.703734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.703979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.704230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.704479 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.704732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.704732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.705173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.705470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.705710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.705958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.706199 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.706510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.706782 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.707030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.707290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.707540 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.707794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.708031 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.708277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.708550 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.708791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.709044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.709283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.709588 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.709851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.710096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.710345 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.710579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.710828 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.711065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.711322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.711322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.711805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.712072 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.712308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.712574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.712813 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.712813 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.713262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.713532 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.713791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.714066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.714066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.714512 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.714753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.715003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.715242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.715242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.715663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.715863 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.716107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.716107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.716535 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.716768 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.717008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.717241 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.717241 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.717730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.717961 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.718186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.718415 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.718640 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.718942 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.719154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.719365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.719598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.719832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.720065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.720272 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.720506 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.720742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.720979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.721220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.721524 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.721762 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.722052 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.722286 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.722541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.722784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.723043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.723299 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.723555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.723780 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.723988 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.724186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.724387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.724597 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.724813 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.725054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.725284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.725562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.725791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726180 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726495 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.726999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.727160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.727315 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.727473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.727634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.727881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.727881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.728128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.728274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.728435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.728435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.728768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.728926 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.729088 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.729246 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.729469 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.729629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.729809 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.729986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.730156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.730320 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.730484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.730663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.730821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.730993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.731177 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.731350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.731513 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.731662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.731800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.732107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.732390 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.732644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733005 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733440 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733600 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733831 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.733966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.734290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.734583 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.734838 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.734995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.735399 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.735737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.735936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.736232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.736549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.736549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.736980 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.737297 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.737495 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738410 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738717 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.738875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739426 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739822 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.739974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740560 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740560 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.740902 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.741936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742261 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742417 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.742972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743713 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.743942 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744366 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744506 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744659 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.744983 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.745142 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.745312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.745503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.745662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.745818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.745990 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.746153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.746301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.746457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.746620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.746770 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.746919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.747141 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.747303 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.747564 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.747702 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.747842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.748005 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.748220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.748404 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.748615 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.748789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.748991 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.749151 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.750353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.750515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.750667 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.750924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751418 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751585 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751585 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751891 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.751891 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.752211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.753271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.754403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.755630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.756764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.758922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.760085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.761232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.762579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.763542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.764571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.765569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.766590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.767861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.769624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.769624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:14:39.769624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 22:14:39.785105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Registered counter for database nova_api Jun 15 22:14:39.808472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:39.819802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:39.848132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Registered counter for database nova_api Jun 15 22:14:39.884997 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:39.894185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:39.907730 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.context [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e2fb47e-e475-4f13-884d-5122f57ae4d4(cell1) {{(pid=117629) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 22:14:39.916073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:14:39.918241 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:14:39.919528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:14:39.921791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:14:39.924259 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Registered counter for database nova_cell0 Jun 15 22:14:39.931575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Registered counter for database nova_cell1 Jun 15 22:14:39.943307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:39.946043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:39.958987 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:39.962348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:39.973670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.context [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e2fb47e-e475-4f13-884d-5122f57ae4d4(cell1) {{(pid=117630) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 22:14:39.980976 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:14:39.983483 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:14:39.984868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:14:39.988473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:14:39.991966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Registered counter for database nova_cell0 Jun 15 22:14:39.999217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Registered counter for database nova_cell1 Jun 15 22:14:40.010400 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:40.015238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:40.025957 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:40.028020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:40.187380 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Registered counter for database nova_cell0 Jun 15 22:14:40.196931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:40.204551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:40.271501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Registered counter for database nova_cell0 Jun 15 22:14:40.288873 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:14:40.297146 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:14:40.754766 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:14:40.768240 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:14:40.900484 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:14:40.915280 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:14:41.247880 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:14:41.254982 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-1872c953-4857-4fc7-9112-29b692cd366e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:14:41.260703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e39aabe9c0 pid: 117630 (default app) Jun 15 22:14:41.534063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 22:14:41.545944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-8ce7476b-4a1c-46c8-b1d1-29bbf56277fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 22:14:41.555813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e39aabe9c0 pid: 117629 (default app) Jun 15 22:15:25.840253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:25.840969 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:25.842229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:25.842969 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:27.814170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1dafb671-cd1a-4534-8e22-8cbfebba26ea tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Action: 'create', calling method: .version_select at 0x7f99e12f3700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-252893147", "metadata": {"Type": "work"}}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:28.033643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-90774c9c-6995-4454-9e06-aabfa8fb874a tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e1d419d0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:28.069556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:28.070964 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:28.072136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:28.074290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:28.883960 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-90774c9c-6995-4454-9e06-aabfa8fb874a tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/78f9f353-6756-478e-8d01-9fbbcc16c52f" status: 200 len: 351 microversion: 2.1 time: 1.297892 Jun 15 22:15:28.892063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 1/1] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:27 2022] GET /compute/v2.1/os-volumes/78f9f353-6756-478e-8d01-9fbbcc16c52f => generated 351 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:29.593560 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1dafb671-cd1a-4534-8e22-8cbfebba26ea tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.769428 Jun 15 22:15:29.598611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 15 22:15:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3776 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 22:15:29.610652 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-35ac25a8-1234-4584-b6ad-c7f7dfaf288c tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Calling method '.version_select at 0x7f99e12495e0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:29.788654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-35ac25a8-1234-4584-b6ad-c7f7dfaf288c tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b" status: 200 len: 352 microversion: 2.1 time: 0.183667 Jun 15 22:15:29.789237 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:29 2022] GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:30.834092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-abf55ca8-da72-4056-8b66-b754d369339e tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Calling method '.version_select at 0x7f99e11bb550>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:31.080128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-abf55ca8-da72-4056-8b66-b754d369339e tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b" status: 200 len: 353 microversion: 2.1 time: 0.279539 Jun 15 22:15:31.081307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:30 2022] GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b => generated 353 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:31.100798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-74dc0790-b577-4c3a-9969-1ebd09937694 tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Calling method '.version_select at 0x7f99e1249670>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:31.171300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c00d74ce-a6b2-4c2e-902a-1bfa30871e8d tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e11bb670>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:31.301554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-74dc0790-b577-4c3a-9969-1ebd09937694 tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b" status: 200 len: 353 microversion: 2.1 time: 0.207636 Jun 15 22:15:31.302780 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:31 2022] GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:31.324302 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c00d74ce-a6b2-4c2e-902a-1bfa30871e8d tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/89cbfb29-b86d-4223-a884-43957998ed88" status: 200 len: 351 microversion: 2.1 time: 0.161456 Jun 15 22:15:31.325172 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 3/6] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:31 2022] GET /compute/v2.1/os-volumes/89cbfb29-b86d-4223-a884-43957998ed88 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:31.328711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f449907b-8ecd-4617-9120-0345ed5c399c tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Calling method '.version_select at 0x7f99e1249dc0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:31.573883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f449907b-8ecd-4617-9120-0345ed5c399c tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b" status: 202 len: 0 microversion: 2.1 time: 0.251941 Jun 15 22:15:31.575310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:15:31 2022] DELETE /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:15:31.584833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a9c9788d-4026-410d-831f-95ee38e11725 tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Calling method '.version_select at 0x7f99e11bbd30>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:31.726479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a9c9788d-4026-410d-831f-95ee38e11725 tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b" status: 200 len: 352 microversion: 2.1 time: 0.146520 Jun 15 22:15:31.727290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:31 2022] GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:32.751369 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f11dfa89-3215-4200-9f0e-d312f132ec8f tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Calling method '.version_select at 0x7f99e12004c0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:32.835567 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-f11dfa89-3215-4200-9f0e-d312f132ec8f tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] HTTP exception thrown: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f11dfa89-3215-4200-9f0e-d312f132ec8f tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Request method failure captured: Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b HTTP/1.1 Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqln9MHdZEudspKrDTpCU3l9HtgyeYnUV8YFIoqkyxHeU3wMEbWwZjzGTW815OWDaBRIyYx_mBvNlNWnJ0374zpkiFMhTEUIai0-HL7SydNcZ6EeByqPV-Z3gVnwWVrWh1R42BRhZcgfOUfpCKUKct8aJigh4fRViY2Xvu_qTU2ENqUs Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 8937185412da45feb828a2dec596f359 Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesGetTestJSON-2124373854 Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:32.839662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8937185412da45feb828a2dec596f359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8937185412da45feb828a2dec596f359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8937185412da45feb828a2dec596f359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8937185412da45feb828a2dec596f359", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesGetTestJSON-2124373854 Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 8937185412da45feb828a2dec596f359 Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesGetTestJSON-2124373854 Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesGetTestJSON-2124373854-project Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 81a18deda10a4b74a1d6dcd135a6a385 Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesGetTestJSON-2124373854-project Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'd77ef207-def8-428e-8629-36243ef4455b'} Jun 15 22:15:32.841155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. (HTTP 404) (Request-ID: req-273efdb1-fc5f-40ea-91d6-85d287fbe5a5) Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:32.842065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:15:32.843162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 22:15:32.844227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f11dfa89-3215-4200-9f0e-d312f132ec8f tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] Returning 404 to user: Volume d77ef207-def8-428e-8629-36243ef4455b could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:32.845448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f11dfa89-3215-4200-9f0e-d312f132ec8f tempest-VolumesGetTestJSON-2124373854 tempest-VolumesGetTestJSON-2124373854-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b" status: 404 len: 109 microversion: 2.1 time: 0.104583 Jun 15 22:15:32.848010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 5/9] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:32 2022] GET /compute/v2.1/os-volumes/d77ef207-def8-428e-8629-36243ef4455b => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:15:33.186718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-57ddfcb4-37ea-448e-bde6-ab280fc2a75b tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e11d1430>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:33.303799 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-57ddfcb4-37ea-448e-bde6-ab280fc2a75b tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/fc885b2e-5093-4beb-b428-32bdaeaa2fa9" status: 200 len: 350 microversion: 2.1 time: 0.123755 Jun 15 22:15:33.305023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 5/10] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:33 2022] GET /compute/v2.1/os-volumes/fc885b2e-5093-4beb-b428-32bdaeaa2fa9 => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:33.323853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-97f120ef-9f83-49df-90a2-529d47ef74e5 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e1200dc0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:33.663498 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-97f120ef-9f83-49df-90a2-529d47ef74e5 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.347097 Jun 15 22:15:33.673997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 6/11] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Jun 15 22:15:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:33.680808 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1e1171f1-d283-4f0f-89fb-0c1ae7758e6f tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e11bbdc0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:33.871430 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1e1171f1-d283-4f0f-89fb-0c1ae7758e6f tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.195301 Jun 15 22:15:33.872012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1148 bytes} [Wed Jun 15 22:15:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:15:33.885850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d5c9caa0-c621-4544-ac98-f744ab2ef11b tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e1200af0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:34.089583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d5c9caa0-c621-4544-ac98-f744ab2ef11b tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.208040 Jun 15 22:15:34.090477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Jun 15 22:15:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:34.103607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9baa4cdc-3537-4208-b30b-0f4af3365cfe tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e11d1790>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:34.261927 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9baa4cdc-3537-4208-b30b-0f4af3365cfe tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.163622 Jun 15 22:15:34.262549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 7/14] 10.222.0.55 () {58 vars in 1166 bytes} [Wed Jun 15 22:15:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:34.294678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-115e2986-4081-4b81-a3c2-b93061ff6a10 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e117a4c0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:34.485497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-115e2986-4081-4b81-a3c2-b93061ff6a10 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.212214 Jun 15 22:15:34.486725 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 8/15] 10.222.0.55 () {58 vars in 1169 bytes} [Wed Jun 15 22:15:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:34.501198 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-61910f90-055d-4b7b-8974-6dff22726a84 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e11db040>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:34.736148 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-61910f90-055d-4b7b-8974-6dff22726a84 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238976 Jun 15 22:15:34.737489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Jun 15 22:15:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:34.749711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-291c9e8d-437c-49db-bb5c-389ecb5efe56 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e1180160>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:34.962997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-291c9e8d-437c-49db-bb5c-389ecb5efe56 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.217905 Jun 15 22:15:34.964023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 9/17] 10.222.0.55 () {58 vars in 1187 bytes} [Wed Jun 15 22:15:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:34.990617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cb5c9462-4002-40af-aa8e-8fbe883092c2 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] Calling method '.version_select at 0x7f99e11d1ca0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:35.262788 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cb5c9462-4002-40af-aa8e-8fbe883092c2 tempest-VolumesTestJSON-1195766583 tempest-VolumesTestJSON-1195766583-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.289214 Jun 15 22:15:35.263985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 9/18] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Jun 15 22:15:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:41.603686 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bcc4008f-5712-4032-83fa-ba1f6467714f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: .version_select at 0x7f99e1beba60>, body: {"keypair": {"name": "tempest-keypair-1171436252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvnWSE2dNRCRzRHtACHX+Iwihr13PeQSJs8L0wf3A/vXUfI8zTEBX66i4cvcAtqFrxWWVJNEVwPhj1prUvXosCrqEaeg90eAMWWfVHDxi58UsihZB2H5J2mxqBg0lZLxQ=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:41.775189 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-bcc4008f-5712-4032-83fa-ba1f6467714f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for project e1c37e59766f45c3a46489befb803ff3. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:15:41.791345 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-bcc4008f-5712-4032-83fa-ba1f6467714f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for user 728f1fbe76564467b378035d0d2d3be5 and project e1c37e59766f45c3a46489befb803ff3. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:15:41.952011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bcc4008f-5712-4032-83fa-ba1f6467714f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.913931 Jun 15 22:15:41.954230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 10/19] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:15:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:47.792897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1329126165", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "networks": [{"uuid": "16182893-09af-4eb5-b45b-7d25217c4af9"}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:48.127559 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] validate_networks() for [('16182893-09af-4eb5-b45b-7d25217c4af9', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:15:48.127719 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-472ff653-2eb9-4707-a2ab-6519511fb5c0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: .version_select at 0x7f99e11538b0>, body: {"keypair": {"name": "tempest-keypair-16986499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnSFYw7EkGf/iILsG5zeZzke21HrnMGNImITGyC8ZAY7QQOyQq6t4XN5wPnA0jArKd3fFXUYk8wOZZqXtAnr4oFUFdLletplMJqDPttr/AfDOZEJU0B0v38DcNL3ip74g=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:48.255783 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-472ff653-2eb9-4707-a2ab-6519511fb5c0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:15:48.306862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-472ff653-2eb9-4707-a2ab-6519511fb5c0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:15:48.487600 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-472ff653-2eb9-4707-a2ab-6519511fb5c0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.821303 Jun 15 22:15:48.493433 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:15:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:15:50.386853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c312f875-1b8c-4878-adda-0e82a11380df tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Action: 'create', calling method: .version_select at 0x7f99e0901940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-874771753", "metadata": {"Type": "work"}}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c312f875-1b8c-4878-adda-0e82a11380df tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Request method failure captured: Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 121 Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloUJN-HNyWS7KBizrh01Hv4vI8zkoF5-28QLwMVr62YY2CqdB_RX-oy_GNtSuywHJDdq3pKMwwanQbj-rT7QZ62LfTtv_TL4AoL9VxRPGQO8Ve_10XwGxvlNrNdbq0QnQJOph_NZkWmhST5zDEgBkGb50Kl6mNofk4y_u-mDQucabE Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:50.409826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccfdbb7ade6d43489315f90d549f1a72", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 37789c7ad2ba466398a003562348647a Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-874771753", "metadata": {"Type": "work"}}} Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:50.411103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-874771753', 'metadata': {'Type': 'work'}}}} Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise error Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:50.411835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 22:15:50.413143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 22:15:50.414158 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 22:15:50.414158 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.415011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c312f875-1b8c-4878-adda-0e82a11380df tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:50.416570 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c312f875-1b8c-4878-adda-0e82a11380df tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.728566 Jun 15 22:15:50.423131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 12/21] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 15 22:15:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1738 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 22:15:50.477991 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db929f52-408c-4b1c-8ed0-896df559faae tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Action: 'create', calling method: .version_select at 0x7f99e0903ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-173296608", "metadata": {"Type": "work"}}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db929f52-408c-4b1c-8ed0-896df559faae tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Request method failure captured: Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 119 Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloUJN-HNyWS7KBizrh01Hv4vI8zkoF5-28QLwMVr62YY2CqdB_RX-oy_GNtSuywHJDdq3pKMwwanQbj-rT7QZ62LfTtv_TL4AoL9VxRPGQO8Ve_10XwGxvlNrNdbq0QnQJOph_NZkWmhST5zDEgBkGb50Kl6mNofk4y_u-mDQucabE Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:50.519283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccfdbb7ade6d43489315f90d549f1a72", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 37789c7ad2ba466398a003562348647a Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-173296608", "metadata": {"Type": "work"}}} Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:50.520456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-173296608', 'metadata': {'Type': 'work'}}}} Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise error Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi '0' Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:50.521096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 22:15:50.522420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 22:15:50.523395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 22:15:50.523395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.523395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db929f52-408c-4b1c-8ed0-896df559faae tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:50.534864 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-db929f52-408c-4b1c-8ed0-896df559faae tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.105291 Jun 15 22:15:50.542698 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 13/22] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 15 22:15:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:15:50.568161 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-86984c69-9877-479b-819c-a48d57f6b8c1 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Action: 'create', calling method: .version_select at 0x7f99e0903d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-220139826", "metadata": {"Type": "work"}}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-86984c69-9877-479b-819c-a48d57f6b8c1 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Request method failure captured: Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 118 Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloUJN-HNyWS7KBizrh01Hv4vI8zkoF5-28QLwMVr62YY2CqdB_RX-oy_GNtSuywHJDdq3pKMwwanQbj-rT7QZ62LfTtv_TL4AoL9VxRPGQO8Ve_10XwGxvlNrNdbq0QnQJOph_NZkWmhST5zDEgBkGb50Kl6mNofk4y_u-mDQucabE Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:50.574245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccfdbb7ade6d43489315f90d549f1a72", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 37789c7ad2ba466398a003562348647a Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-220139826", "metadata": {"Type": "work"}}} Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:50.576729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-220139826', 'metadata': {'Type': 'work'}}}} Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise error Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi '' Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:50.578216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 22:15:50.580886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 22:15:50.584314 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 22:15:50.584314 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.594536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-86984c69-9877-479b-819c-a48d57f6b8c1 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:50.597464 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-86984c69-9877-479b-819c-a48d57f6b8c1 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.047005 Jun 15 22:15:50.599416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 14/23] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 15 22:15:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 22:15:50.629349 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8adc96d4-6704-4083-8a0a-c37c17e1576a tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Calling method '.version_select at 0x7f99e09019d0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:50.739787 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-8adc96d4-6704-4083-8a0a-c37c17e1576a tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] HTTP exception thrown: Volume tempest-invalid-790957126 could not be found. Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8adc96d4-6704-4083-8a0a-c37c17e1576a tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Request method failure captured: Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-790957126 HTTP/1.1 Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloUJN-HNyWS7KBizrh01Hv4vI8zkoF5-28QLwMVr62YY2CqdB_RX-oy_GNtSuywHJDdq3pKMwwanQbj-rT7QZ62LfTtv_TL4AoL9VxRPGQO8Ve_10XwGxvlNrNdbq0QnQJOph_NZkWmhST5zDEgBkGb50Kl6mNofk4y_u-mDQucabE Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:50.745500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccfdbb7ade6d43489315f90d549f1a72", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 37789c7ad2ba466398a003562348647a Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Volume tempest-invalid-790957126 could not be found. Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'tempest-invalid-790957126'} Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:50.747724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-790957126 could not be found. (HTTP 404) (Request-ID: req-22e7ba8c-6c86-4f18-a163-baa99eaa66e5) Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.750009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 22:15:50.752436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-790957126 could not be found. Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:15:50.755845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-790957126 could not be found. Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-790957126 could not be found. Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8adc96d4-6704-4083-8a0a-c37c17e1576a tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Returning 404 to user: Volume tempest-invalid-790957126 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:50.759065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8adc96d4-6704-4083-8a0a-c37c17e1576a tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-790957126" status: 404 len: 98 microversion: 2.1 time: 0.142625 Jun 15 22:15:50.767073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 15/24] 10.222.0.55 () {58 vars in 1214 bytes} [Wed Jun 15 22:15:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-790957126 => generated 98 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 15 22:15:50.812493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2b1e93b0-f0de-4d8a-ab29-97999f48f371 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.037132 Jun 15 22:15:50.838468 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 16/25] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Jun 15 22:15:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 22:15:50.864113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ba2bef6f-ec9d-4f3a-a19a-7aeca8840d49 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021612 Jun 15 22:15:50.882585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 17/26] 10.222.0.55 () {58 vars in 1136 bytes} [Wed Jun 15 22:15:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 22:15:50.892613 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-88009185-0ac5-4fe9-b797-54b94d0313a2 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Calling method '.version_select at 0x7f99e1beb8b0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:51.004750 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-88009185-0ac5-4fe9-b797-54b94d0313a2 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] HTTP exception thrown: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-88009185-0ac5-4fe9-b797-54b94d0313a2 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Request method failure captured: Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/os-volumes/ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 HTTP/1.1 Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloUJN-HNyWS7KBizrh01Hv4vI8zkoF5-28QLwMVr62YY2CqdB_RX-oy_GNtSuywHJDdq3pKMwwanQbj-rT7QZ62LfTtv_TL4AoL9VxRPGQO8Ve_10XwGxvlNrNdbq0QnQJOph_NZkWmhST5zDEgBkGb50Kl6mNofk4y_u-mDQucabE Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:51.008748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccfdbb7ade6d43489315f90d549f1a72", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 37789c7ad2ba466398a003562348647a Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'ccaf05bf-602f-4d71-a5ac-bdbc06d03e42'} Jun 15 22:15:51.009937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. (HTTP 404) (Request-ID: req-bdd269da-026d-41f9-bfda-12643bca056e) Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:51.010593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 22:15:51.011522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 22:15:51.012421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. Jun 15 22:15:51.013365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.017868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-88009185-0ac5-4fe9-b797-54b94d0313a2 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Returning 404 to user: Volume ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:51.021003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-88009185-0ac5-4fe9-b797-54b94d0313a2 tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/ccaf05bf-602f-4d71-a5ac-bdbc06d03e42" status: 404 len: 109 microversion: 2.1 time: 0.133353 Jun 15 22:15:51.022986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 18/27] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:15:50 2022] DELETE /compute/v2.1/os-volumes/ccaf05bf-602f-4d71-a5ac-bdbc06d03e42 => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:15:51.047298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8b6a4ded-d456-431b-a99f-ab08223ca2fd tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Calling method '.version_select at 0x7f99e1153670>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:51.147898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-8b6a4ded-d456-431b-a99f-ab08223ca2fd tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] HTTP exception thrown: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8b6a4ded-d456-431b-a99f-ab08223ca2fd tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Request method failure captured: Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-volumes/9ce30aeb-a94a-448c-95ea-9c0c97982a25 HTTP/1.1 Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloUJN-HNyWS7KBizrh01Hv4vI8zkoF5-28QLwMVr62YY2CqdB_RX-oy_GNtSuywHJDdq3pKMwwanQbj-rT7QZ62LfTtv_TL4AoL9VxRPGQO8Ve_10XwGxvlNrNdbq0QnQJOph_NZkWmhST5zDEgBkGb50Kl6mNofk4y_u-mDQucabE Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:15:51.152014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ccfdbb7ade6d43489315f90d549f1a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ccfdbb7ade6d43489315f90d549f1a72", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ccfdbb7ade6d43489315f90d549f1a72 Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-75464252 Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 37789c7ad2ba466398a003562348647a Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-75464252-project Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '9ce30aeb-a94a-448c-95ea-9c0c97982a25'} Jun 15 22:15:51.153963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. (HTTP 404) (Request-ID: req-3ee37a36-9be6-430a-9b80-188c7c91f00c) Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:51.155963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:15:51.160223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 22:15:51.166875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:15:51.169945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8b6a4ded-d456-431b-a99f-ab08223ca2fd tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] Returning 404 to user: Volume 9ce30aeb-a94a-448c-95ea-9c0c97982a25 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:15:51.175170 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8b6a4ded-d456-431b-a99f-ab08223ca2fd tempest-VolumesNegativeTest-75464252 tempest-VolumesNegativeTest-75464252-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9ce30aeb-a94a-448c-95ea-9c0c97982a25" status: 404 len: 109 microversion: 2.1 time: 0.126491 Jun 15 22:15:51.176375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 19/28] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:15:51 2022] GET /compute/v2.1/os-volumes/9ce30aeb-a94a-448c-95ea-9c0c97982a25 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:15:53.624085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2063565125", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:53.908202 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] validate_networks() for [('940602c4-8f41-4c18-9ab7-0dca7ab44fe8', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:15:54.404237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:15:54.404818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:15:54.405124 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:15:54.405581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:15:54.405995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:15:54.438326 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:54.441639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:54.445971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:54.446490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:54.544452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Getting quotas for project 0d340df02c724bee810b3f8874379cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:15:54.566484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Getting quotas for user 5fd1bd3a55de406d9f4b2adf35bef024 and project 0d340df02c724bee810b3f8874379cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:15:54.663830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:15:54.684378 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:15:54.951810 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a7756532-5ae2-4a6f-91f8-a46ce7d1006e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.990317 Jun 15 22:15:54.952118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 10/29] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 7993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:15:55.011845 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2143856558", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8775d530-af5d-47c6-94ff-035a35c09c54"}], "security_groups": [{"name": "tempest-securitygroup--243324755"}], "key_name": "tempest-keypair-1171436252", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:55.649854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] validate_networks() for [('8775d530-af5d-47c6-94ff-035a35c09c54', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:15:57.156173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:15:57.157161 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:15:57.158591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:15:57.159362 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:15:57.159853 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:15:57.179788 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:57.183463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:15:57.184372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:15:57.184506 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:15:57.184902 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:15:57.185417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:15:57.191919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:57.194785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:57.199756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:57.210832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:57.214549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:57.215611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:57.216150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:57.265528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for project e1c37e59766f45c3a46489befb803ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:15:57.277598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for user 728f1fbe76564467b378035d0d2d3be5 and project e1c37e59766f45c3a46489befb803ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:15:57.293845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:15:57.304930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for user 9be9445fdbc4459da4feb7c0bc1b310f and project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:15:57.310812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:15:57.316484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:15:57.345273 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:15:57.353692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:15:57.465164 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-265fa649-70ba-4805-906e-8372095a1a65 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.510711 Jun 15 22:15:57.465933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 11/30] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:15:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:15:57.483413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1994e807-d954-4ab2-bb2c-1fe07b098538 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:57.490674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1994e807-d954-4ab2-bb2c-1fe07b098538 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:15:57.617761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-39e3b07e-5e05-44f4-b867-a8fa84c73052 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.376256 Jun 15 22:15:57.624619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 20/31] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:15:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 5382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:15:57.638421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-69103141", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51970d37-d292-4c3d-bdb6-727ed5d05edc"}], "security_groups": [{"name": "tempest-securitygroup--1538025216"}], "key_name": "tempest-keypair-16986499", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:15:57.699802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1994e807-d954-4ab2-bb2c-1fe07b098538 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:15:57.721694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1994e807-d954-4ab2-bb2c-1fe07b098538 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1215 microversion: 2.1 time: 0.253651 Jun 15 22:15:57.737807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 12/32] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:15:57 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:57.768689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fe486117-42e6-4963-89ea-7c94055f3c12 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:57.771554 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fe486117-42e6-4963-89ea-7c94055f3c12 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:15:57.954258 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fe486117-42e6-4963-89ea-7c94055f3c12 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:15:57.961664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fe486117-42e6-4963-89ea-7c94055f3c12 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1238 microversion: 2.1 time: 0.222259 Jun 15 22:15:57.965888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 13/33] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:15:57 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1238 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:57.981603 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2f79bcde-515d-4f14-aacc-4ca4b8dd405f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:57.984596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2f79bcde-515d-4f14-aacc-4ca4b8dd405f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:15:58.036019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] validate_networks() for [('51970d37-d292-4c3d-bdb6-727ed5d05edc', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:15:58.843549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2f79bcde-515d-4f14-aacc-4ca4b8dd405f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:15:58.886659 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2f79bcde-515d-4f14-aacc-4ca4b8dd405f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1222 microversion: 2.1 time: 0.917833 Jun 15 22:15:58.892155 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 14/34] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:15:57 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1222 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:58.926882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:58.927729 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:15:58.966043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:58.969194 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:58.971305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:58.980417 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:59.634403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:15:59.678262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5c4f3052-9adb-4e37-960d-51a08194fb27 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1267 microversion: 2.1 time: 0.776068 Jun 15 22:15:59.689737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 15/35] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:15:58 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1267 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:15:59.695230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-07f8ee6a-8190-43a9-b0d5-41a3ad9c03e1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:15:59.711100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-07f8ee6a-8190-43a9-b0d5-41a3ad9c03e1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:15:59.852809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:15:59.853471 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:15:59.854485 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:15:59.854965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:15:59.855389 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:15:59.889227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:59.895952 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:59.899243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:15:59.905203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:15:59.921738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-07f8ee6a-8190-43a9-b0d5-41a3ad9c03e1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:15:59.957908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-07f8ee6a-8190-43a9-b0d5-41a3ad9c03e1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1238 microversion: 2.1 time: 0.263000 Jun 15 22:15:59.960922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 16/36] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:15:59 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1238 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:00.002869 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:16:00.003055 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-477579042", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:00.013006 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:16:00.073271 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:16:00.083526 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:16:00.246884 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] validate_networks() for [('940602c4-8f41-4c18-9ab7-0dca7ab44fe8', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:16:00.248590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-10043f3e-b148-440c-b11b-697f9e4cce08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.627553 Jun 15 22:16:00.252115 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 21/37] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:15:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:16:00.266205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a7885787-f619-4997-8b9f-35135dddc4d8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:00.268105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a7885787-f619-4997-8b9f-35135dddc4d8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:00.495497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a7885787-f619-4997-8b9f-35135dddc4d8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:00.531707 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a7885787-f619-4997-8b9f-35135dddc4d8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1238 microversion: 2.1 time: 0.270617 Jun 15 22:16:00.535331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 22/38] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:00 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1238 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:00.713786 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:00.741175 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:00.823438 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:00.828711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:00.833247 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:00.839691 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:01.442674 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:01.481388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-64f88ba1-7505-41c7-b66c-6ff0b2f18234 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1273 microversion: 2.1 time: 0.785335 Jun 15 22:16:01.481939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 23/39] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:00 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1273 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:01.503798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:01.534983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:01.544112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:01.550420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:01.555330 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:01.556159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:01.798939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:01.830929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-db2cea25-fa5f-45e6-ad60-b5e9aea84011 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1290 microversion: 2.1 time: 0.325712 Jun 15 22:16:01.832433 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 24/40] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:01 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1290 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:01.838506 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:01.847518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:01.867862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:01.876634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:01.877674 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:01.880058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:02.729992 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:02.766354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8ae7de3f-501d-49a7-9556-fd9003f09a08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1242 microversion: 2.1 time: 0.930145 Jun 15 22:16:02.774448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 25/41] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:01 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1242 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:02.802863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:02.804390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:02.824509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:02.825225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:02.826270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:02.827025 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:03.032746 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:16:03.033742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:16:03.034540 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:16:03.035245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:16:03.035959 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:16:03.076243 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:03.078145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:03.080842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:03.088855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:03.183828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:16:03.192305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for user 9be9445fdbc4459da4feb7c0bc1b310f and project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:16:03.217381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:16:03.223994 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:16:03.263366 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:03.290767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a55b6208-b1a1-4c0c-9300-258af1c2ed62 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1273 microversion: 2.1 time: 0.511776 Jun 15 22:16:03.294610 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 26/42] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:02 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1273 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:03.327093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:03.327744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:03.347339 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:03.349580 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:03.350476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:03.350927 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:03.387512 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-601095c4-2941-4222-a5d0-f971ac40b9f7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.413271 Jun 15 22:16:03.390815 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 17/43] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:15:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:16:03.402034 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a4cfba1e-4b6b-41cc-962b-f141cfedf552 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:03.406360 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a4cfba1e-4b6b-41cc-962b-f141cfedf552 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:03.767797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4cfba1e-4b6b-41cc-962b-f141cfedf552 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:03.798552 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a4cfba1e-4b6b-41cc-962b-f141cfedf552 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1221 microversion: 2.1 time: 0.393760 Jun 15 22:16:03.799342 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 18/44] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:03 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1221 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:03.817306 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:03.817998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:03.863251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:03.867423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:03.868548 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:03.875029 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:04.260278 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:04.278914 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4193fe5c-9ab9-442f-9b93-6b86f34bee61 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1234 microversion: 2.1 time: 0.472802 Jun 15 22:16:04.279593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 19/45] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:03 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1234 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:04.322912 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:04.323825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:04.339517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:04.347806 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:04.350710 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:04.361990 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:04.544739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:04.561432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1b77688d-91de-49bc-888b-2ecc47ee3c5f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1296 microversion: 2.1 time: 1.260931 Jun 15 22:16:04.566940 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 27/46] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:03 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1296 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:04.705826 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:04.722431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-196a1156-7b11-41ec-8b90-46de86f7b196 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1273 microversion: 2.1 time: 0.403072 Jun 15 22:16:04.723286 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 20/47] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:04 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:04.818528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:04.819723 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:04.837379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:04.839010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:04.843249 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:04.843749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:04.990967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:05.000420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dec312e6-55eb-433b-82a9-ed037c9ca61a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1225 microversion: 2.1 time: 0.187198 Jun 15 22:16:05.010926 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 28/48] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:04 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1225 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:05.306349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:05.307711 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:05.328367 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:05.338740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:05.340444 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:05.343499 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:05.586084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:05.586874 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:05.601785 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:05.602522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:05.603555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:05.605978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:05.911016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:05.958227 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ec9a3dba-252a-41c0-b2c4-b1a9c4d05557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1290 microversion: 2.1 time: 0.655527 Jun 15 22:16:05.959791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 21/49] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:05 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1290 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:05.976195 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:05.982542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:05.999702 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:06.000482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:06.002114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:06.003198 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:06.222876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:06.259492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1f01a5ce-f844-4f60-9fd8-4f83c12a4925 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1296 microversion: 2.1 time: 0.679127 Jun 15 22:16:06.279635 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 29/50] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:05 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1296 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:06.347387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:06.348209 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:06.402212 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:06.408991 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:06.417311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:06.420521 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:06.948264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:06.959300 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7a88430c-a1e0-4bf5-896b-8ca85d809ab4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1217 microversion: 2.1 time: 0.675442 Jun 15 22:16:06.973636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 30/51] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:06 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1217 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:06.991007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:06.997392 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:07.036362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:07.038496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:07.041383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:07.041832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:07.145817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:07.166773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-763f377e-6659-416a-9336-d41ce66e67d8 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 1.198766 Jun 15 22:16:07.177225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 22/52] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:05 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:07.297467 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:07.298967 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:07.309038 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:07.316771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:07.317963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:07.318594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:07.438073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:07.458835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5a9b8e94-32c2-4567-bcb5-be319dd3ffcd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1308 microversion: 2.1 time: 0.479872 Jun 15 22:16:07.466427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 31/53] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:06 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:07.706473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:07.721223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-afa86a4d-28ac-417b-b2a2-5402fd291f03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1296 microversion: 2.1 time: 0.428435 Jun 15 22:16:07.721629 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 23/54] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:07 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1296 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:07.976550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:07.978022 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:07.993298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:07.994198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:07.995623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:07.997953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.191091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:08.192516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:08.215826 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:08.219289 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.224630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:08.226215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.496684 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:08.509886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd503697-db0d-4a62-8981-8fa9a80f3645 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1281 microversion: 2.1 time: 0.537159 Jun 15 22:16:08.511129 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 32/55] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:07 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1281 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:08.517037 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:08.527729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:08.538805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:08.539428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.540387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:08.541007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.694233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:08.704467 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ea9680c7-5b24-43ba-a8cb-a799a8d51483 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.191801 Jun 15 22:16:08.718485 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 33/56] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:08 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:08.739052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:08.740312 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:08.757376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:08.758278 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.759403 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:08.760826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:08.937891 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:08.951232 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2035bb2b-9f57-4b4d-85e3-8a9fa2f98854 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1296 microversion: 2.1 time: 0.212970 Jun 15 22:16:08.961494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 34/57] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:08 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1296 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:09.531523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:09.534703 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:09.544009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:09.557993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:09.559745 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:09.560390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:09.807325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:09.815561 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ffc154e3-65c9-483f-ae41-dcdd6fefbf5f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.287905 Jun 15 22:16:09.820934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 35/58] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:09 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:09.837054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:09.838710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:09.853556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:09.854249 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:09.855209 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:09.855759 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:09.969107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=4 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:09.989255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:10.028728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1b38d827-edc7-46e7-a5b1-b10ae8ec5f03 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 1.842712 Jun 15 22:16:10.038907 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 24/59] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:08 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:10.064554 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:10.087842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:10.112082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.121183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.122573 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.126215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.300244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:10.313819 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9f7bf342-a706-4e6e-9762-87f2edaa8e06 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.482005 Jun 15 22:16:10.315408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 36/60] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:09 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:10.560975 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:10.570596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-67f83749-9ae1-4b57-8c46-04f9a24f7a31 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.529663 Jun 15 22:16:10.573190 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 25/61] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:10 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:10.749663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=22 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:10.839252 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:10.840716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:10.858257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-edd3a313-255a-44a4-b63f-ab31c5011247 req-c4787310-0c3f-43ea-9668-1464a3d36fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb59e48-8e20-4238-b880-a1052494e259", "tag": "a9fd5de7-410d-45c9-83b6-f3360734e833"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:10.864553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.865013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.865829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.866266 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.879189 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-edd3a313-255a-44a4-b63f-ab31c5011247 req-c4787310-0c3f-43ea-9668-1464a3d36fe8 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.880006 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-edd3a313-255a-44a4-b63f-ab31c5011247 req-c4787310-0c3f-43ea-9668-1464a3d36fe8 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.903030 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-edd3a313-255a-44a4-b63f-ab31c5011247 req-c4787310-0c3f-43ea-9668-1464a3d36fe8 service nova] Creating event network-changed:a9fd5de7-410d-45c9-83b6-f3360734e833 for instance fbb59e48-8e20-4238-b880-a1052494e259 on hv-cinder-83538 Jun 15 22:16:10.903614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-edd3a313-255a-44a4-b63f-ab31c5011247 req-c4787310-0c3f-43ea-9668-1464a3d36fe8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 22:16:10.905111 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.905779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.906789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:10.907954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:10.919892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.compute.rpcapi [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 22:16:10.921131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] Releasing lock "compute-rpcapi-router" {{(pid=117629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 22:16:10.951187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f926f7c8-afa3-4fc6-a66e-7ac956d7e2fe None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207756 Jun 15 22:16:10.951985 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 37/62] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:10.976237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:10.986920 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-80021124-f254-4627-839b-e525e1a4338d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.153021 Jun 15 22:16:10.987518 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 26/63] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:10 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:11.051325 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:11.052278 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:11.058984 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.059435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.060533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.061089 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.183920 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-5cd7036b-a3fa-4b13-8c84-07c986d709e6 req-aa03a6b2-8a94-42e2-b4aa-fdd078348c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8", "tag": "5349d20e-592a-407e-a1f5-695dbc88a11a"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:11.188104 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:11.195607 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5cd7036b-a3fa-4b13-8c84-07c986d709e6 req-aa03a6b2-8a94-42e2-b4aa-fdd078348c9e service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.196063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5cd7036b-a3fa-4b13-8c84-07c986d709e6 req-aa03a6b2-8a94-42e2-b4aa-fdd078348c9e service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.209223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-5cd7036b-a3fa-4b13-8c84-07c986d709e6 req-aa03a6b2-8a94-42e2-b4aa-fdd078348c9e service nova] Creating event network-changed:5349d20e-592a-407e-a1f5-695dbc88a11a for instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 on hv-cinder-83538 Jun 15 22:16:11.214898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-5cd7036b-a3fa-4b13-8c84-07c986d709e6 req-aa03a6b2-8a94-42e2-b4aa-fdd078348c9e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261015 Jun 15 22:16:11.215489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 38/64] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:11.250069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:11.263348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-346aff0a-6812-49db-a114-859fbcd7b45e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.215868 Jun 15 22:16:11.264361 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 27/65] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:11 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:11.337124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:11.337888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:11.347799 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.348253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.349028 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.349503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.416624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:11.420186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:11.425201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-427aea87-c411-4c85-9abc-bc140a4d4987 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.092822 Jun 15 22:16:11.425672 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 39/66] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:11 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:11.590233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:11.590852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:11.599159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.599159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.599593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:11.600041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:11.758481 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:11.766150 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8f64caa7-e835-4fa9-866d-6cd1e402ef91 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.180015 Jun 15 22:16:11.766728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 28/67] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:11 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:12.009573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:12.010191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:12.018535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.019132 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.020396 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.021214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.111598 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:12.122682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0d2ced21-5d1a-4ad0-9f67-b7306aa37f0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.117849 Jun 15 22:16:12.123436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 40/68] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:12 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:12.281800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:12.282834 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:12.295697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.296305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.297467 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.298060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.442496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:12.443145 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:12.466790 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.468154 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.469337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.470016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.529757 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:12.539747 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7effb677-5da1-4306-a6bb-aeaf9780d745 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.261894 Jun 15 22:16:12.541455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 29/69] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:12 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:12.674860 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:12.684213 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-db144207-39d6-4b45-969b-e8b7360c760f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.245719 Jun 15 22:16:12.693696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 41/70] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:12 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:12.784613 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:12.785635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:12.792729 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.796230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:12.798052 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:12.798699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.053647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:13.062314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6662ba54-9260-4929-a509-fce9591e8d4f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.281964 Jun 15 22:16:13.062901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 30/71] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:12 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:13.139183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:13.140319 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:13.147514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:13.153685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.155274 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:13.156109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.250979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:13.265852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-deae2bc6-1207-4369-b61e-3869c52fe54e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.128002 Jun 15 22:16:13.276211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 42/72] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:13 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:13.568160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:13.569057 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:13.572758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:13.578135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:13.578593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.579492 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:13.580079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.702466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:13.703399 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:13.719450 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:13.719930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.720963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:13.721968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:13.769952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:13.774946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=28 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:13.786013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3be8e7df-1dee-4187-8b0f-7cdce40ba662 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.223003 Jun 15 22:16:13.786689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 31/73] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:13 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:13.855671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:13.870401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e63a0d3e-837b-4547-ac81-d146dec7e240 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.172735 Jun 15 22:16:13.873404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 43/74] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:13 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:14.080578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:14.081455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:14.088453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:14.106587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.107751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.109114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.110016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.284160 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:14.284872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:14.297499 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.297951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.302640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.303776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.306625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:14.316149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-918e9e1c-36bc-46ff-bc20-17e6e87b26d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.239866 Jun 15 22:16:14.326050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 32/75] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:14 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:14.393523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:14.402531 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-41916c08-c4cf-44c4-b3f3-a3aecb471aeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.122853 Jun 15 22:16:14.403126 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 44/76] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:14 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:14.804486 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:14.805314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:14.812085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.812847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.813876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.814522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.835619 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:14.890528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:14.891221 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:14.898581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.899334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.900287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:14.900894 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:14.993204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:14.994418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:15.001122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-119d8558-9851-496a-9d97-e12d1c54ef52 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.116436 Jun 15 22:16:15.007457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 45/77] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:14 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:15.008021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-476acc93-c2ab-41fa-b6a6-e52047425ddd tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.204130 Jun 15 22:16:15.008021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 33/78] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:14 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:15.334290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:15.334964 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:15.341739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:15.342493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:15.343279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:15.343779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:15.420840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:15.421512 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:15.428274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:15.428718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:15.429529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:15.430587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:15.555256 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:15.574881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fdae8fdc-a1c1-41d7-a1fd-3b00961ce239 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.157999 Jun 15 22:16:15.576184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 34/79] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:15 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:15.643518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:15.653653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-27b72254-ca2e-4f42-a900-ce41a415957f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.323528 Jun 15 22:16:15.666472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 46/80] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:15 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:16.024376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:16.024740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:16.025221 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:16.025419 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:16.034386 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.036159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.036840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.037879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.038486 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.039745 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.040579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.041240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.179798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:16.188065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7d89877e-7b90-47bc-86f2-28df7d310854 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.167893 Jun 15 22:16:16.205932 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 47/81] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:16 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:16.230793 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:16.237555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-19135b12-77df-4294-b78d-9e3a5a116fd1 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.217228 Jun 15 22:16:16.238906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 35/82] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:16 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:16.593467 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:16.594250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:16.604567 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.606270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.608341 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.609948 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.675413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:16.676143 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:16.715598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.716373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.721083 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:16.721817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:16.797684 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:16.814317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f78bd426-3dd6-48d0-9be9-d513fa4153cd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.225657 Jun 15 22:16:16.821486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 48/83] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:16 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:17.054435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:17.068027 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7aff743a-9dd7-4258-b78b-cb9cd048750f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.396924 Jun 15 22:16:17.068624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 36/84] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:16 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:17.205827 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:17.206775 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:17.217926 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:17.218357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:17.219210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:17.219643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:17.255184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:17.255794 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:17.263064 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:17.263512 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:17.264307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:17.264727 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:17.375686 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:17.390028 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7ec254bd-05bd-42eb-bf54-0c9b861ec356 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.188067 Jun 15 22:16:17.395843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 49/85] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:17 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:17.840119 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:17.842336 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:17.862110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:17.863097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:17.866713 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:17.869622 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:17.877754 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:17.886314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a140393f-b18e-490f-8ea6-ffcc931c832f tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.634964 Jun 15 22:16:17.894153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 37/86] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:17 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:18.019232 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:18.030274 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-57167b4d-3076-4ce8-8355-188637e0d800 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.195276 Jun 15 22:16:18.034809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 50/87] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:17 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:18.089305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:18.090161 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:18.101869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.102576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:18.103551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.104135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:18.412544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:18.413433 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:18.420435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.420850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:18.421650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.422077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:18.533052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:18.543367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b9fc8a85-c251-4508-a618-80220317ec2b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1296 microversion: 2.1 time: 0.134687 Jun 15 22:16:18.555091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 51/88] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:18 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:18.600039 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:18.619889 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-69ab86a3-2d2e-437b-9fbe-a309c5818656 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.537365 Jun 15 22:16:18.630068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 38/89] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:18 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:18.852287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-c32fac02-792b-410e-986d-1bc94d3dfe5d req-b3692138-c8f3-4843-be00-010ffa508c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6aaf51e-4c52-4369-93d6-cab9d1aa1322", "tag": "c9c6920c-14fa-4def-95f3-a52bc33fd374"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:18.863688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c32fac02-792b-410e-986d-1bc94d3dfe5d req-b3692138-c8f3-4843-be00-010ffa508c3c service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.865000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c32fac02-792b-410e-986d-1bc94d3dfe5d req-b3692138-c8f3-4843-be00-010ffa508c3c service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:18.891075 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-c32fac02-792b-410e-986d-1bc94d3dfe5d req-b3692138-c8f3-4843-be00-010ffa508c3c service nova] Creating event network-changed:c9c6920c-14fa-4def-95f3-a52bc33fd374 for instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 on hv-cinder-83538 Jun 15 22:16:18.897196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-c32fac02-792b-410e-986d-1bc94d3dfe5d req-b3692138-c8f3-4843-be00-010ffa508c3c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052474 Jun 15 22:16:18.898061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 52/90] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:18.910561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:18.911195 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:18.919723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.920814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:18.920924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:18.921421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.052894 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:19.053878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:19.062207 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:19.063258 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.064731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:19.065309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.182922 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:19.195105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-447109cb-1b63-473b-9faa-1147c99e8701 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1279 microversion: 2.1 time: 0.146783 Jun 15 22:16:19.196048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 53/91] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:19 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:19.304979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:19.315080 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-414bc902-8f93-45e1-8194-4a5cdd464ccc tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.408701 Jun 15 22:16:19.316563 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 39/92] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:18 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:19.563965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:19.564500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:19.571266 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:19.571800 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.572712 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:19.573161 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.638098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:19.639000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:19.646675 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:19.647120 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.647893 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:19.648315 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:19.723161 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:19.731011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9c90d0e3-af94-417d-a194-a59c1fbc15ec tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.171365 Jun 15 22:16:19.731899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 54/93] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:19 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:19.791860 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:19.799434 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9ca31580-c571-4332-9e3e-178898ec7c8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.165413 Jun 15 22:16:19.800006 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 40/94] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:19 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:20.212568 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:20.213262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:20.220246 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.220934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.222122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.223028 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.352515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:20.355253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:20.366362 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.366720 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.367683 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.368141 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.410812 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:20.421551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1fdc5165-f24e-43b7-94ee-75f678707a4e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.213102 Jun 15 22:16:20.422652 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 55/95] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:20 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:20.540880 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:20.549289 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7aeafb7c-8d8f-4271-ada3-11353be8a4ea tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.218395 Jun 15 22:16:20.549983 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 41/96] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:20 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:20.748571 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:20.750021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:20.758642 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.758642 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.764786 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.766704 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.819726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:20.819726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:20.825437 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.825871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.826942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:20.827591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:20.921173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:21.162805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:21.178723 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ef735e77-8f26-4332-b050-75febe778cf6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.434239 Jun 15 22:16:21.179644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 56/97] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:20 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:21.442128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:21.451912 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:21.452562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:21.459252 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2a828d0d-f2e2-436b-8b39-91e87b763aae tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.646532 Jun 15 22:16:21.460463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 42/98] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:20 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:21.465176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:21.473957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:21.475046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:21.475567 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:21.494514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:21.568817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:21.569794 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:21.580694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:21.581216 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:21.585102 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:21.585682 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:22.014991 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:22.027863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2c6cd796-14b4-416c-8d62-c16fbcc6cb62 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.582345 Jun 15 22:16:22.029909 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 57/99] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:21 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:22.196120 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:22.196814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:22.204421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:22.204872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:22.207260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:22.208255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:22.386340 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:22.394527 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-55f68da8-c5c2-4568-ad31-1228842bb01b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.202786 Jun 15 22:16:22.396012 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 58/100] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:22 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:22.400342 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:22.412039 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-03d2062e-90df-4086-9249-b2af7f3eef2c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.847431 Jun 15 22:16:22.412683 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 43/101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:21 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:22.483782 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:22.484692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:22.494295 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:22.495055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:22.496063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:22.496652 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:22.722452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:22.733907 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-815ec307-e6bb-43d7-9012-4ef2263c8c07 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.254301 Jun 15 22:16:22.734516 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 59/102] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:22 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:22.972631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-15eb3762-a547-4685-b238-9dc087e45852 req-bd2c1f91-ca8d-4297-8972-654df173ae99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c2ed2d-ebef-45a1-a6e7-4b624b642c27", "tag": "310ea2f0-df91-4235-8abb-98fd6be92641"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:23.054408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:23.055718 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:23.063777 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.064393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.065315 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.066446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.076013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-15eb3762-a547-4685-b238-9dc087e45852 req-bd2c1f91-ca8d-4297-8972-654df173ae99 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.076476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-15eb3762-a547-4685-b238-9dc087e45852 req-bd2c1f91-ca8d-4297-8972-654df173ae99 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.108743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-15eb3762-a547-4685-b238-9dc087e45852 req-bd2c1f91-ca8d-4297-8972-654df173ae99 service nova] Creating event network-changed:310ea2f0-df91-4235-8abb-98fd6be92641 for instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 on hv-cinder-83538 Jun 15 22:16:23.109504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-15eb3762-a547-4685-b238-9dc087e45852 req-bd2c1f91-ca8d-4297-8972-654df173ae99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 22:16:23.110806 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.111403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.112352 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.112931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.131425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.compute.rpcapi [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 22:16:23.132581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] Releasing lock "compute-rpcapi-router" {{(pid=117630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 22:16:23.163486 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e3e88485-1344-408f-9bc4-4d2aafc9c417 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241586 Jun 15 22:16:23.164083 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 44/103] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:23.258586 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:23.267265 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a33103ee-2cc0-45f4-846d-0ce6e4925eac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.218840 Jun 15 22:16:23.267863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 60/104] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:23 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:23.414488 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:23.415432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:23.422800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.423248 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.424018 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.424449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.429059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:23.429751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:23.436530 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.437166 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.438669 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.439148 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.576362 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:23.584014 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-14984c04-4dae-4db2-86a6-e36d3c43445e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.175139 Jun 15 22:16:23.584791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 45/105] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:23 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:23.588783 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:23.596691 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-440d02cd-50e1-4327-a3ab-a406f748e570 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.172380 Jun 15 22:16:23.597276 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 61/106] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:23 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:23.751037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:23.751542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:23.758873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.759324 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.760109 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:23.760546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:23.911626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:23.919827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b95215df-a980-4051-8ce7-fc863059fe8a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.172785 Jun 15 22:16:23.920397 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 46/107] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:23 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:24.287669 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:24.288275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:24.294997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.295448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.296211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.296644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.432283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:24.440184 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4206ff84-0a7a-407d-9bca-dd6a8eb98404 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.158488 Jun 15 22:16:24.440763 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 62/108] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:24 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:24.601675 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:24.602291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:24.610706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.611246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.612416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.612762 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.616305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:24.617414 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:24.624365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.625066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.626100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.626879 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.764646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:24.772510 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:24.775004 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0c5202e1-4bed-401d-8945-e5ec092796dd tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.175032 Jun 15 22:16:24.775004 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 47/109] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:24 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:24.780854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bd6a2928-424c-4fe7-a90a-82d9ed3ebdcb tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.170647 Jun 15 22:16:24.781498 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 63/110] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:24 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:24.937650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:24.938678 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:24.945834 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.945834 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:24.946591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:24.947040 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.099517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:25.107409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8115589b-549a-4999-8f7b-43d3c8ca16f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.173735 Jun 15 22:16:25.108008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 48/111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:24 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:25.178311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-c8fd77d2-fd58-4119-96d7-414c65473e5d req-a620bc88-5879-4200-a1be-033c4e836e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b32ad40-764f-44d0-a589-d823eee5b508", "tag": "4dc0def1-b88d-4f1c-9be4-a801af02f48a"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:25.186746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c8fd77d2-fd58-4119-96d7-414c65473e5d req-a620bc88-5879-4200-a1be-033c4e836e72 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.187204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c8fd77d2-fd58-4119-96d7-414c65473e5d req-a620bc88-5879-4200-a1be-033c4e836e72 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.201920 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-c8fd77d2-fd58-4119-96d7-414c65473e5d req-a620bc88-5879-4200-a1be-033c4e836e72 service nova] Creating event network-changed:4dc0def1-b88d-4f1c-9be4-a801af02f48a for instance 5b32ad40-764f-44d0-a589-d823eee5b508 on hv-cinder-83538 Jun 15 22:16:25.207968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-c8fd77d2-fd58-4119-96d7-414c65473e5d req-a620bc88-5879-4200-a1be-033c4e836e72 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033626 Jun 15 22:16:25.209430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 64/112] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:25.459796 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:25.460206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:25.467035 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.467401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.468248 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.468735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.626455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:25.635731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-56199ec6-fa9b-4a3a-80bb-6fbe50801350 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.182231 Jun 15 22:16:25.636311 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 49/113] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:25 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:25.794165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:25.795091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:25.800075 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:25.800682 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:25.801635 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.802647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.803496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.804012 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.807172 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.807696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.808541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:25.809044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:25.829676 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:25.956613 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:25.965253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bcdb118d-107f-418e-b31c-560e26314eee tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.169701 Jun 15 22:16:25.966632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 50/114] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:25 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:25.968664 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:25.982259 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8138c594-4f53-40fd-b889-cb5027fb530a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.193815 Jun 15 22:16:25.983212 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 65/115] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:25 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:26.125166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:26.125856 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:26.132737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:26.133215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:26.133999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:26.134427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:26.319647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:26.331046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-65907989-6642-4b8a-9420-89a87c17af2a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.208982 Jun 15 22:16:26.331979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 51/116] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:26 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:26.653429 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:26.654652 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:26.668137 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:26.668252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:26.669047 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:26.669520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:26.982774 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:26.983425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:26.995980 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:26.997390 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:27.003504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:27.005601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:27.119877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:27.154250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-73a19a8f-a8f2-4668-aeb8-4be8ef18476c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.502806 Jun 15 22:16:27.155133 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 66/117] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:26 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:27.164321 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:27.165181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:27.192068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:27.193214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:27.194639 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:27.195291 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:27.622862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:27.633734 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-235e244f-7d5b-4167-b147-d862f8f150b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.476164 Jun 15 22:16:27.634578 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 67/118] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:27 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:27.649038 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:27.649877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:27.658072 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:27.658812 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:27.659655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:27.660156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:27.834945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:27.836030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:27.845556 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fed4a77a-17d7-43c9-ad97-65bd2a64846d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.866950 Jun 15 22:16:27.846127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d831096d-73af-4e68-8297-919f5be3a55a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.199396 Jun 15 22:16:27.846644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 52/119] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:26 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:27.846753 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 68/120] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:27 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:28.174911 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:28.175549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:28.182749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:28.183202 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:28.184377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:28.185066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:28.390455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:28.398985 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dc46ed0f-b2fb-489a-a0e7-8467952aad6e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.228489 Jun 15 22:16:28.406588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 69/121] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:28 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:28.651546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:28.652475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:28.662473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:28.663581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:28.665437 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:28.666659 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:28.865447 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:28.866353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:28.889556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:28.898034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:28.899626 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:28.903847 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:29.144925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:29.186038 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c99da36f-763f-4533-ae96-2081bc83b3c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.532828 Jun 15 22:16:29.204457 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 53/122] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:28 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:29.216059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:29.217776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:29.225056 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:29.225764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:29.227077 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:29.227675 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:29.290099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:29.302658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a181d817-1e23-4a89-bd48-a3bb24ad4a51 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.439661 Jun 15 22:16:29.303758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 70/123] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:28 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:29.417212 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:29.418028 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:29.424833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:29.425605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:29.427016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:29.427614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:29.434703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:29.450488 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c01a5243-147f-4635-ab3e-e400b704817c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.241732 Jun 15 22:16:29.452436 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 54/124] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:29 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:29.636493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:29.649112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6011c1cd-8587-4a3f-b7e4-8c551ac5c92b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.231816 Jun 15 22:16:29.658892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 71/125] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:29 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:30.234056 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:30.235651 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:30.257674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.258663 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.259740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.264260 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.320555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:30.321983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:30.328596 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.338085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.339436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.340076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.705074 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:30.718786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f3123313-a83d-4e4f-8251-ebda815c2a78 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.510344 Jun 15 22:16:30.719998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 55/126] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:30 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:30.726377 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:30.727254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:30.735871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.736684 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.737759 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.738511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.869878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:30.887605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e74086a1-125a-434f-816e-98f1c3fb55ef tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.570735 Jun 15 22:16:30.889921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 72/127] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:30 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:30.909261 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:30.910993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:30.925659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.926716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:30.931915 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:30.933446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:31.060274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:31.070686 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bd06a76b-de93-4481-9abb-863a7c0bfde6 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.349010 Jun 15 22:16:31.072235 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 56/128] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:30 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:31.242648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:31.263130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9aa208e1-a215-4b86-bae8-851c9a264912 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.371321 Jun 15 22:16:31.274050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 73/129] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:30 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:31.736693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:31.737405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:31.750882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:31.754248 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:31.756749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:31.761153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:31.908109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:31.909906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:31.921555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:31.926290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:31.928538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:31.930422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:31.984967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:32.098743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:32.130415 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aad9e69e-4243-4e71-a6ec-04575bc4a4eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.397977 Jun 15 22:16:32.132439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 57/130] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:31 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:32.164079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:32.165597 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:32.188515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:32.189313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:32.190351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:32.190790 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:32.302194 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:32.313738 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b195e563-2e24-420c-8d6e-be6ad8f56acc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.410245 Jun 15 22:16:32.314335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 74/131] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:31 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:32.332959 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:32.336242 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:32.354004 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:32.354478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:32.357540 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:32.360128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:32.601043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:32.616465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a0029f6e-23ac-43ad-9020-cb3c3055220b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.478409 Jun 15 22:16:32.618055 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 58/132] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:32 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:32.729414 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:32.742408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-82bc2bc1-7751-4c77-bfc1-dd1c8d51eded tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.422484 Jun 15 22:16:32.745722 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 75/133] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:32 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:33.131832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:33.144499 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-7c94ec2f-85d1-4841-a75f-ce5fdd2324bb req-667f4bd2-b60b-448f-b4db-f7337b58c768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8", "name": "network-vif-plugged", "status": "completed", "tag": "5349d20e-592a-407e-a1f5-695dbc88a11a"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:33.153671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:33.154434 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:33.166346 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.171062 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.173205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.174883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.186660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7c94ec2f-85d1-4841-a75f-ce5fdd2324bb req-667f4bd2-b60b-448f-b4db-f7337b58c768 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.187419 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7c94ec2f-85d1-4841-a75f-ce5fdd2324bb req-667f4bd2-b60b-448f-b4db-f7337b58c768 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.218796 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-7c94ec2f-85d1-4841-a75f-ce5fdd2324bb req-667f4bd2-b60b-448f-b4db-f7337b58c768 service nova] Creating event network-vif-plugged:5349d20e-592a-407e-a1f5-695dbc88a11a for instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 on hv-cinder-83538 Jun 15 22:16:33.228354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-7c94ec2f-85d1-4841-a75f-ce5fdd2324bb req-667f4bd2-b60b-448f-b4db-f7337b58c768 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283684 Jun 15 22:16:33.238055 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 59/134] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:33.340955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:33.343967 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:33.364167 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.365363 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.370087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.370830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.493653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:33.507196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-db7c0e10-dd29-4280-b876-0d6e6d2c437c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.358270 Jun 15 22:16:33.509760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 76/135] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:33 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:33.640123 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:33.641267 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:33.677344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.677634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.684769 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.686048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.742770 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:33.760748 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dacc00b1-bd31-454e-b437-22ef7dfaab1a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.429554 Jun 15 22:16:33.766136 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 60/136] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:33 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:33.781267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:33.787642 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:33.805713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.807633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.812975 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:33.813899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:33.981299 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:33.990373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-44cdc641-ae44-40ec-a2cc-594a6a097849 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.358051 Jun 15 22:16:33.998505 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 77/137] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:33 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:34.348541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:34.358498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9d34c655-9906-4d07-8b48-70dadc3d1f30 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.590787 Jun 15 22:16:34.359545 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 61/138] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:33 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:34.526880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:34.528230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:34.535059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:34.535425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:34.536281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:34.536804 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:34.696023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:34.704734 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-79202ce3-47fe-4fab-b4de-d29e2d9306a4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.182112 Jun 15 22:16:34.706606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 78/139] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:34 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:34.797567 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:34.798524 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:34.805418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:34.806265 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:34.807054 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:34.807675 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.009211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:35.009536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:35.010473 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:35.018726 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.019412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.020729 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.021421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.024346 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-45e75680-1a4a-4c93-a487-e30de9da8265 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.229035 Jun 15 22:16:35.036631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 62/140] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:34 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:35.202641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:35.211885 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-efac3cd5-7640-4196-9684-b7677b920902 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.208121 Jun 15 22:16:35.212511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 79/141] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:35 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:35.277105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-c0b4ad8d-3acb-4381-99f0-c23db2250bfb req-f55104bc-1523-4ef6-9049-77e561ea248d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb59e48-8e20-4238-b880-a1052494e259", "name": "network-vif-plugged", "status": "completed", "tag": "a9fd5de7-410d-45c9-83b6-f3360734e833"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:35.299074 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c0b4ad8d-3acb-4381-99f0-c23db2250bfb req-f55104bc-1523-4ef6-9049-77e561ea248d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.300734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c0b4ad8d-3acb-4381-99f0-c23db2250bfb req-f55104bc-1523-4ef6-9049-77e561ea248d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.334939 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-c0b4ad8d-3acb-4381-99f0-c23db2250bfb req-f55104bc-1523-4ef6-9049-77e561ea248d service nova] Creating event network-vif-plugged:a9fd5de7-410d-45c9-83b6-f3360734e833 for instance fbb59e48-8e20-4238-b880-a1052494e259 on hv-cinder-83538 Jun 15 22:16:35.342331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-c0b4ad8d-3acb-4381-99f0-c23db2250bfb req-f55104bc-1523-4ef6-9049-77e561ea248d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075165 Jun 15 22:16:35.343581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 63/142] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:35.375862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:35.376481 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:35.387172 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.387633 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.388428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.388861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.708913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:35.722654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cb47dc0b-910f-4a6c-abd3-2044d93b8aaf tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.350743 Jun 15 22:16:35.723786 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 80/143] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:35 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:35.728608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:35.729253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:35.737934 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.738698 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.740496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:35.741126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:35.932945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:35.940864 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cf8feec7-8d15-4e47-820f-b0a0ad1d6a93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.220030 Jun 15 22:16:35.942014 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 64/144] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:35 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:36.043205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:36.043941 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:36.050483 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.051015 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.051933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.052379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.230688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:36.232003 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:36.246575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:36.248577 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.249251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.252308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.253034 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.256603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-57c081ff-09bc-4e41-9b63-6a651e2828d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.217025 Jun 15 22:16:36.257588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 81/145] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:36 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:36.430532 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:36.438688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7b5b1954-e0b3-4ff5-8bb0-727aa5a8a74b tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1315 microversion: 2.1 time: 0.214225 Jun 15 22:16:36.449042 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 65/146] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:36 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:36.740736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:36.742262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:36.754647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.755200 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.756009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.756463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.904052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:36.912023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e30c9ae-ab87-4916-9e66-176a7465d676 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.175766 Jun 15 22:16:36.912612 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 82/147] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:36 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:36.962255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:36.963228 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:36.970510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.971142 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:36.972123 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:36.972636 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.131802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:37.140807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-142df6cc-84ce-4626-ba11-39acc62a2737 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.183607 Jun 15 22:16:37.141588 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 66/148] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:36 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:37.277278 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:37.278401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:37.285628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.286018 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.287009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.287913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.361067 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-353a9fbb-5ec9-4bf8-b2a9-8838af7b3b34 req-7a8f387d-81a1-46fa-850b-c598477e1b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aaf51e-4c52-4369-93d6-cab9d1aa1322", "name": "network-vif-plugged", "status": "completed", "tag": "c9c6920c-14fa-4def-95f3-a52bc33fd374"}, {"server_uuid": "5b32ad40-764f-44d0-a589-d823eee5b508", "name": "network-vif-plugged", "status": "completed", "tag": "4dc0def1-b88d-4f1c-9be4-a801af02f48a"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:37.371190 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-353a9fbb-5ec9-4bf8-b2a9-8838af7b3b34 req-7a8f387d-81a1-46fa-850b-c598477e1b1a service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.371731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-353a9fbb-5ec9-4bf8-b2a9-8838af7b3b34 req-7a8f387d-81a1-46fa-850b-c598477e1b1a service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.386727 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-353a9fbb-5ec9-4bf8-b2a9-8838af7b3b34 req-7a8f387d-81a1-46fa-850b-c598477e1b1a service nova] Creating event network-vif-plugged:c9c6920c-14fa-4def-95f3-a52bc33fd374 for instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 on hv-cinder-83538 Jun 15 22:16:37.387306 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-353a9fbb-5ec9-4bf8-b2a9-8838af7b3b34 req-7a8f387d-81a1-46fa-850b-c598477e1b1a service nova] Creating event network-vif-plugged:4dc0def1-b88d-4f1c-9be4-a801af02f48a for instance 5b32ad40-764f-44d0-a589-d823eee5b508 on hv-cinder-83538 Jun 15 22:16:37.394027 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-353a9fbb-5ec9-4bf8-b2a9-8838af7b3b34 req-7a8f387d-81a1-46fa-850b-c598477e1b1a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036919 Jun 15 22:16:37.394905 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 67/149] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:37.443906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:37.452583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5291cab7-f9c1-42dd-bbd5-dd0c42cbf7c8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.180037 Jun 15 22:16:37.453407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 83/150] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:37 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:37.457736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:37.458772 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:37.465693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.466142 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.466917 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.467345 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.613046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:37.621944 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6b4a2260-cbd3-4ef7-ab82-d39360584f80 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1503 microversion: 2.1 time: 0.169446 Jun 15 22:16:37.622832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 68/151] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:37 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:37.932841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:37.933529 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:37.953303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.953822 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:37.955668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:37.957968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:38.137900 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:38.145624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4251ff18-cff9-4b95-89e5-d7d1f2ba685a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.218145 Jun 15 22:16:38.146234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 84/152] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:37 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:38.161346 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:38.162879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:38.169646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:38.170091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:38.170901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:38.171322 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:38.176627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:38.329017 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:38.341062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2422593b-6290-48c7-98a1-44113d367390 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.184765 Jun 15 22:16:38.342041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 69/153] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:38 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:38.470631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:38.471228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:38.480030 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:38.480947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:38.481886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:38.482509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:38.617749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:38.625744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2180854d-b65d-4c3d-aa7b-1dded2a8ed54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.158959 Jun 15 22:16:38.626317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 85/154] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:38 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:39.163780 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:39.164592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:39.176373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.178075 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.179066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.179691 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.359427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:39.360034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:39.368764 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:39.369762 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.371136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.371980 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.373305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.381056 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-50db8ef2-7d0a-4f23-bde0-e49b2161234b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.221483 Jun 15 22:16:39.383811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 70/155] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:39 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:39.428618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-546ac42f-9804-432c-8973-197d5a03f6ac req-e3553de5-8eef-47a2-8c41-4f832293a4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c2ed2d-ebef-45a1-a6e7-4b624b642c27", "name": "network-vif-plugged", "status": "completed", "tag": "310ea2f0-df91-4235-8abb-98fd6be92641"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:39.456098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-546ac42f-9804-432c-8973-197d5a03f6ac req-e3553de5-8eef-47a2-8c41-4f832293a4ab service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.459695 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-546ac42f-9804-432c-8973-197d5a03f6ac req-e3553de5-8eef-47a2-8c41-4f832293a4ab service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.486883 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-546ac42f-9804-432c-8973-197d5a03f6ac req-e3553de5-8eef-47a2-8c41-4f832293a4ab service nova] Creating event network-vif-plugged:310ea2f0-df91-4235-8abb-98fd6be92641 for instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 on hv-cinder-83538 Jun 15 22:16:39.495682 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-546ac42f-9804-432c-8973-197d5a03f6ac req-e3553de5-8eef-47a2-8c41-4f832293a4ab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082937 Jun 15 22:16:39.497598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 71/156] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:39.581291 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:39.592952 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-861539d4-c791-4ea4-9312-f32bcfda78d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.237528 Jun 15 22:16:39.593742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 86/157] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:39 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:39.643537 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:39.644232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:39.650858 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.651499 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.652526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:39.652969 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:39.805345 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:39.812972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e04c1dc7-de52-461c-be32-22c85dfd404a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.173705 Jun 15 22:16:39.813735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 72/158] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:39 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:40.401459 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:40.403220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:40.410174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:40.410924 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:40.412316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:40.413081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:40.592076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:40.600757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0aaae0ac-65b7-4897-9b6b-30556aae7cf5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.203714 Jun 15 22:16:40.601483 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 87/159] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:40 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:40.615843 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:40.616489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:40.628281 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:40.629108 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:40.630691 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:40.631365 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:40.828080 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:40.834399 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:40.835401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:40.836398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d3c6d43f-190b-4c2b-8f51-37b9c5425eef tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.228818 Jun 15 22:16:40.836987 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 73/160] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:40 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:40.847202 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:40.853265 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:40.853726 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:40.854562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:40.854993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:40.992802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:41.002552 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-35585504-8d3f-4e0a-9a3b-b92d871fc590 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.174605 Jun 15 22:16:41.003367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 88/161] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:40 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:41.125527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e15fafb-6861-4b1f-af24-d124055706ba"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:41.126996 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:41.134425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:41.134940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:41.135999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:41.136426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:41.620444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:41.621711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:41.629109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:41.629655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:41.631176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:41.631624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:41.786091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:41.797681 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a4368812-1fe4-4ebc-a619-4c6f3dac0e3c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.182248 Jun 15 22:16:41.798329 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 89/162] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:41 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:41.854833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:41.855576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:41.861990 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:41.862427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:41.863197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:41.863619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:41.999815 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:42.009946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-59a94060-357d-40ce-8951-021fda53bfce tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.159713 Jun 15 22:16:42.010925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 90/163] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:41 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:42.025763 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:42.026370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:42.035670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:42.035670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:42.035670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:42.035670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:42.040735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:42.191617 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:42.199558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b7699653-7216-42e2-b319-831ad97407f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.180578 Jun 15 22:16:42.200059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 91/164] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:42 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:42.816950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:42.816950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:42.822655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:42.823103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:42.823861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:42.824292 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:42.971088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:42.978810 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-766a8984-529d-4f85-a40f-625a684f0a21 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.167781 Jun 15 22:16:42.979387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 92/165] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:42 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:43.028231 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:43.028929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:43.035570 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:43.036000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:43.036944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:43.037449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:43.230370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:43.253951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a3c16056-9c1b-4733-868a-74b97a5952d1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.229348 Jun 15 22:16:43.254925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 93/166] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:43 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:43.286009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:43.287273 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:43.300480 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:43.302174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:43.304044 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:43.304898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:43.594186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8b92ac1d-4931-4a6e-a7c7-b5c538c0528e tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "POST /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.472706 Jun 15 22:16:43.595386 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 74/167] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:16:41 2022] POST /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259/os-volume_attachments => generated 194 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:43.657958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:43.667421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-456ae068-ac2d-4622-8657-dc1f33e7768d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.390235 Jun 15 22:16:43.668208 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 94/168] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:43 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:43.997213 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1550291437", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:44.002270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:44.002884 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:44.011046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.011865 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.012828 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.013252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.073558 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] validate_networks() for None {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:16:44.193976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:44.202239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e9ba523-0283-48e8-995c-63bc91e9ab87 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.203634 Jun 15 22:16:44.203037 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 95/169] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:43 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:44.278670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:44.279845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:44.287343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.288189 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.292171 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.292710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.518569 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:44.546472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-afc6d6f6-ab6c-4848-815b-2de3b5267da7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1364 microversion: 2.1 time: 0.270687 Jun 15 22:16:44.562106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 96/170] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:44 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:44.584693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:16:44.584693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:16:44.586263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:16:44.586263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:16:44.586263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:16:44.588566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=87 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:44.607915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.608909 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.609735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.610332 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.638361 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Getting quotas for project 4b9143eb19784ee68d32ba580bc47797. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:16:44.643804 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Getting quotas for user 9a20070eef754e669bcdbcc83fd44a5c and project 4b9143eb19784ee68d32ba580bc47797. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:16:44.657246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:16:44.660113 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:16:44.685055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:44.685702 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:44.692686 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.693608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.694697 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:44.695451 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:44.725570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-52daf4bc-c0c7-4118-9add-da136f020a68 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731645 Jun 15 22:16:44.725570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 75/171] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:16:44.744365 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3d6c0a35-287a-4390-a0be-e9d1c7a3b92e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:44.744805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3d6c0a35-287a-4390-a0be-e9d1c7a3b92e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:44.862598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3d6c0a35-287a-4390-a0be-e9d1c7a3b92e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:44.877460 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3d6c0a35-287a-4390-a0be-e9d1c7a3b92e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1215 microversion: 2.1 time: 0.139599 Jun 15 22:16:44.878114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 76/172] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:44 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:44.918518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:44.926741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fc9c86ae-b181-4c51-92ad-9f37400ea41f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.245621 Jun 15 22:16:44.927892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 97/173] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:44 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:45.219435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:45.220382 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:45.232737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.233181 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.234337 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.234985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.378498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:45.387184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-947ca290-7c90-4082-90dc-dc30c125fe80 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.171555 Jun 15 22:16:45.387778 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 77/174] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:45 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:45.571850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:45.573375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:45.579851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.580379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.581060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.581515 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.790808 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:45.813036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e8c2468d-bf3a-4455-bf34-41b7f85cee2f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1554 microversion: 2.1 time: 0.245284 Jun 15 22:16:45.831337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 98/175] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:45 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1554 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:45.838545 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:45.839124 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:45.849149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.850212 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.851217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.851823 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.895002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:45.895609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:45.902334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.902779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.905957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:45.906656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:45.974907 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:45.987628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-056c3f57-caf8-4361-8b7c-828758ea46f0 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1219 microversion: 2.1 time: 0.093624 Jun 15 22:16:45.987628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 99/176] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:45 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:45.990947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:45.991647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:45.996245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f7b3f00c-f94d-4dff-8539-27cbc245e646 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163551 Jun 15 22:16:45.997032 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 78/177] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:16:45 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:46.000253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:46.000705 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:46.001589 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:46.002026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:46.404656 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:46.405343 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:46.416091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:46.416526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:46.417356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:46.417814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:46.576372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:46.587960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c7e9fafd-3858-44e3-8159-b8bebc838583 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1321 microversion: 2.1 time: 0.187521 Jun 15 22:16:46.590772 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 79/178] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:46 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:46.623644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:46.636360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78f1aac8-b789-4ed1-b4d7-d27c385a2e28 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1363 microversion: 2.1 time: 0.649409 Jun 15 22:16:46.637092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 100/179] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:45 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1363 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:47.002716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:47.003323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:47.016683 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.017299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.018716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.019260 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.110929 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:47.141430 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e9baf2c6-7a04-412d-8be7-457a81d5bbe6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1219 microversion: 2.1 time: 0.143234 Jun 15 22:16:47.154036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 80/180] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:46 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:47.597696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-00e3d8aa-ef76-40d4-a684-8d28297df0cd req-d13696d1-88c0-4f29-92c1-707a08ab02a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c2ed2d-ebef-45a1-a6e7-4b624b642c27", "tag": "310ea2f0-df91-4235-8abb-98fd6be92641"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:47.606399 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:47.606996 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:47.623896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.624339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.625113 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.625567 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.634233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-00e3d8aa-ef76-40d4-a684-8d28297df0cd req-d13696d1-88c0-4f29-92c1-707a08ab02a9 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.634723 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-00e3d8aa-ef76-40d4-a684-8d28297df0cd req-d13696d1-88c0-4f29-92c1-707a08ab02a9 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.648041 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-00e3d8aa-ef76-40d4-a684-8d28297df0cd req-d13696d1-88c0-4f29-92c1-707a08ab02a9 service nova] Creating event network-changed:310ea2f0-df91-4235-8abb-98fd6be92641 for instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 on hv-cinder-83538 Jun 15 22:16:47.653392 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-00e3d8aa-ef76-40d4-a684-8d28297df0cd req-d13696d1-88c0-4f29-92c1-707a08ab02a9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059268 Jun 15 22:16:47.654150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 101/181] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:47.660380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:47.661057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:47.679583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.679908 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.680672 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.681097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.776939 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:47.786045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4153c718-28ba-4b89-b131-155332668a0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1515 microversion: 2.1 time: 0.182862 Jun 15 22:16:47.786652 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 81/182] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:47 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:47.804814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:47.805847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:47.812094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.812533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.813287 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.813896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.828659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:47.839709 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-919a4ee2-0bf4-4e60-a4a0-9d596d688ed9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1549 microversion: 2.1 time: 0.183941 Jun 15 22:16:47.840681 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 102/183] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:47 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:47.858999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:47.859633 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:47.863258 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'flavor' on Instance uuid 5b32ad40-764f-44d0-a589-d823eee5b508 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:16:47.866797 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.867525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.868365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:47.868847 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:47.996563 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-024dd73e-41c8-40ee-a071-e6f5e74ec813 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508/action" status: 200 len: 32 microversion: 2.1 time: 0.196473 Jun 15 22:16:47.997293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 82/184] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:16:47 2022] POST /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:16:48.001434 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fcd11d9a-10e6-4f8d-81ba-58b3b80cac7a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143031 Jun 15 22:16:48.001434 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 103/185] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:16:47 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:16:48.007012 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:48.007679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:48.024841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:48.025213 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:48.026033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:48.026472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:48.173827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:48.175197 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:48.188761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:48.189494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:48.190521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:48.191199 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:48.259394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:48.267476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d2805387-0de8-408b-b4a5-57787d75a15d tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1211 microversion: 2.1 time: 0.099056 Jun 15 22:16:48.268049 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 83/186] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:48 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:48.330759 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:48.342352 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d4547c6a-586d-4f6a-9950-e1410f5c791e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.339597 Jun 15 22:16:48.342939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 104/187] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:48 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:49.293169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:49.295354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:49.303972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:49.305182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:49.306304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:49.306995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:49.361608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:49.362217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:49.376854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:49.378559 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:49.379791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:49.381314 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:49.405086 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:49.413868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-331d9ce2-2027-4e83-adbf-0e396cf38d02 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1267 microversion: 2.1 time: 0.129444 Jun 15 22:16:49.414992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 84/188] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:49 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:49.740939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:49.779158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-7b4c10e9-66a1-41e4-9061-54ade646bde8 req-51c6fdee-c54e-4e74-bea3-aa2fba17eaba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6aaf51e-4c52-4369-93d6-cab9d1aa1322", "tag": "c9c6920c-14fa-4def-95f3-a52bc33fd374"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:49.783979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-14db7c64-19f3-40bc-ad10-4714b5bb95eb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.407814 Jun 15 22:16:49.808376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 105/189] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:49 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:49.833030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7b4c10e9-66a1-41e4-9061-54ade646bde8 req-51c6fdee-c54e-4e74-bea3-aa2fba17eaba service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:49.833530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7b4c10e9-66a1-41e4-9061-54ade646bde8 req-51c6fdee-c54e-4e74-bea3-aa2fba17eaba service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:49.848423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:49.874744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-7b4c10e9-66a1-41e4-9061-54ade646bde8 req-51c6fdee-c54e-4e74-bea3-aa2fba17eaba service nova] Creating event network-changed:c9c6920c-14fa-4def-95f3-a52bc33fd374 for instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 on hv-cinder-83538 Jun 15 22:16:49.888535 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-7b4c10e9-66a1-41e4-9061-54ade646bde8 req-51c6fdee-c54e-4e74-bea3-aa2fba17eaba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117917 Jun 15 22:16:49.889983 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 85/190] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:50.435400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:50.436779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:50.456175 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:50.456625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:50.457817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:50.458735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:50.614497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:50.625793 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-97a6b959-5b83-4a68-895e-609daf318472 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1273 microversion: 2.1 time: 0.194360 Jun 15 22:16:50.630523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 106/191] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:50 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:50.851595 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:50.858053 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:50.884032 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:50.888812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:50.891594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:50.895055 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:51.236999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:51.250109 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fc9fbbcb-c7f0-48d9-9130-bd5fc286ef83 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.414455 Jun 15 22:16:51.251811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 86/192] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:50 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:51.648165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:51.648735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:51.655586 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:51.656033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:51.657164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:51.657640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:51.727944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:51.737803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1aef18fb-771d-41cc-a140-a15d573c2a36 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1273 microversion: 2.1 time: 0.094109 Jun 15 22:16:51.738497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 107/193] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:51 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:52.270585 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:52.271326 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:52.278432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:52.278873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:52.279671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:52.280098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:52.433240 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:52.441358 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f3c7381a-b0ef-4361-a37a-fb776ca771e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.175542 Jun 15 22:16:52.442283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 87/194] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:52 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:52.756377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:52.756938 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:52.763328 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:52.763770 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:52.764531 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:52.764958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:52.901695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:52.905417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:52.910554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4270389d-1736-4cdd-9840-9517b13ea4f5 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.158205 Jun 15 22:16:52.911138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 108/195] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:52 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:53.459112 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:53.459722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:53.467133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:53.467570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:53.468354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:53.468784 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:53.618565 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:53.629541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c0894afa-506f-463c-9555-8628b3804b5a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.174104 Jun 15 22:16:53.630185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 88/196] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:53 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:53.934248 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:53.935738 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:53.942413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:53.942856 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:53.943612 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:53.944037 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:54.078800 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:54.090631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9d289bb5-3c63-4c60-9b02-e1b48549687f tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.160986 Jun 15 22:16:54.091370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 109/197] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:53 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:54.645868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:54.646453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:54.649132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:54.656669 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:54.657762 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:54.658592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:54.659092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:54.872354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:54.878140 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:54.886617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-55d4f9bb-940e-4411-9a48-f7cd68a77e39 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.244485 Jun 15 22:16:54.887552 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 89/198] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:54 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:55.114630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:55.115857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:55.125045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:55.125517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:55.126292 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:55.126719 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:55.274380 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-e5e69510-83ba-4768-8f4b-7a92eed48ec0 req-1e1e37d8-00c1-4476-aace-eb29b16650ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc63399-177f-412a-9000-adee5a743df6", "tag": "a8f0becc-e113-4c39-80a3-e6accfa8ceaf"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:16:55.300285 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-e5e69510-83ba-4768-8f4b-7a92eed48ec0 req-1e1e37d8-00c1-4476-aace-eb29b16650ae service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:55.300725 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-e5e69510-83ba-4768-8f4b-7a92eed48ec0 req-1e1e37d8-00c1-4476-aace-eb29b16650ae service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:55.315204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:55.316348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-e5e69510-83ba-4768-8f4b-7a92eed48ec0 req-1e1e37d8-00c1-4476-aace-eb29b16650ae service nova] Creating event network-changed:a8f0becc-e113-4c39-80a3-e6accfa8ceaf for instance acc63399-177f-412a-9000-adee5a743df6 on hv-cinder-83538 Jun 15 22:16:55.321910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-e5e69510-83ba-4768-8f4b-7a92eed48ec0 req-1e1e37d8-00c1-4476-aace-eb29b16650ae service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051487 Jun 15 22:16:55.322860 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 90/199] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:16:55.324650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ae72db81-0c79-4290-8c06-f2f896d24a65 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.214937 Jun 15 22:16:55.326995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 110/200] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:55 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:55.912303 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:55.913517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:55.924687 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:55.925435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:55.926643 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:55.927322 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:56.080790 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:56.089540 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a1f7a36c-6593-48c4-a0c6-8e84ce24afd9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.183988 Jun 15 22:16:56.090044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 91/201] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:55 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:56.342275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:56.342854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:56.351716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:56.352193 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:56.352951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:56.355653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:56.610845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:56.615242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:56.615730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:56.622196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9fb7e3e3-9ca0-4486-9ac8-c0e253952d11 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.282090 Jun 15 22:16:56.624192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 111/202] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:56 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:56.628155 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:56.628807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:56.629654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:56.646984 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:56.689943 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:16:56.826731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ca586f86-7843-4ce8-b819-452a387a74ab tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 204 len: 0 microversion: 2.1 time: 0.216284 Jun 15 22:16:56.827789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 92/203] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:16:56 2022] DELETE /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 22:16:56.836982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:56.837807 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:56.848517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:56.849383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:56.850424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:56.850931 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:57.022214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:57.030836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4067c6b0-bc68-4ba1-908f-900895956932 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1555 microversion: 2.1 time: 0.198037 Jun 15 22:16:57.033455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 112/204] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:56 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:57.112604 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:57.113465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:57.120859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:57.121470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:57.122341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:57.122849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:57.286215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:57.297025 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8e0b9010-00fe-4eb3-b901-cb9293c61cec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.192413 Jun 15 22:16:57.298223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 93/205] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:57 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:57.643178 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:57.643818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:57.649915 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:57.650605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:57.651528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:57.651970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:57.801262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:57.808874 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3b806a5d-6137-4e1d-b915-a59aacdadcbb tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.170554 Jun 15 22:16:57.809492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 113/206] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:57 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:58.050720 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:58.054987 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:58.058698 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:58.059249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:58.060504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:58.061040 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:58.260548 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:58.276136 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b0f012f0-0d06-4a79-bedd-db3532fbaa84 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1555 microversion: 2.1 time: 0.231758 Jun 15 22:16:58.276742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 94/207] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:58 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:58.322185 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:58.323397 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:58.331190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:58.332216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:58.333164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:58.334649 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:58.493077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:58.503309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b3212f74-ab13-4368-acba-d60a08b874f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.185035 Jun 15 22:16:58.504331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 114/208] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:58 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:16:58.827195 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:58.827802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:58.833911 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:58.834670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:58.835428 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:58.835869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:59.093209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:59.104047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c68427a-1ae4-4c02-b886-77852bb27106 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.280916 Jun 15 22:16:59.104787 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 95/209] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:58 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:59.294820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:59.295433 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:59.301935 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:59.302385 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:59.303136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:59.303568 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:59.483385 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:59.496149 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-68a4e632-605d-4b21-8624-ae95f16587be tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1555 microversion: 2.1 time: 0.205262 Jun 15 22:16:59.497919 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 115/210] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:59 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:16:59.520489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:16:59.521201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:16:59.528457 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:59.529083 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:59.529916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:16:59.530353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:16:59.694728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:16:59.702926 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-96be5c59-5832-430f-9a4f-afdd711da629 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.186213 Jun 15 22:16:59.703667 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 96/211] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:16:59 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:00.120815 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:00.121453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:00.146693 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:00.147317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:00.148234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:00.148841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:00.380171 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:00.392593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1731d7bc-4c60-4f5a-8c63-c66cd43eb026 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.275388 Jun 15 22:17:00.404916 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 116/212] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:00 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:00.522146 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:00.524368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:00.533225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:00.534308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:00.535261 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:00.536848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:00.722986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:00.724246 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:00.732889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:00.733576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:00.734878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:00.735623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:00.828204 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:00.841278 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1983de32-3168-4013-ad71-d44058bdaa81 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1555 microversion: 2.1 time: 0.327001 Jun 15 22:17:00.857103 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 97/213] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:00 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:00.925290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:00.934822 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d66edca0-3d4a-4a63-bef0-89ac55ae2aa6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.218217 Jun 15 22:17:00.935424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 117/214] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:00 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:01.354429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-6cb5eb98-6f80-47e4-ade6-10d87ab8beca req-66770f44-f0c1-4c64-8100-951ee9ca6e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb59e48-8e20-4238-b880-a1052494e259", "name": "network-vif-deleted", "tag": "a9fd5de7-410d-45c9-83b6-f3360734e833"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:01.367625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-6cb5eb98-6f80-47e4-ade6-10d87ab8beca req-66770f44-f0c1-4c64-8100-951ee9ca6e36 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.368366 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-6cb5eb98-6f80-47e4-ade6-10d87ab8beca req-66770f44-f0c1-4c64-8100-951ee9ca6e36 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.393724 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-6cb5eb98-6f80-47e4-ade6-10d87ab8beca req-66770f44-f0c1-4c64-8100-951ee9ca6e36 service nova] Creating event network-vif-deleted:a9fd5de7-410d-45c9-83b6-f3360734e833 for instance fbb59e48-8e20-4238-b880-a1052494e259 on hv-cinder-83538 Jun 15 22:17:01.408419 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-6cb5eb98-6f80-47e4-ade6-10d87ab8beca req-66770f44-f0c1-4c64-8100-951ee9ca6e36 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067835 Jun 15 22:17:01.409719 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 98/215] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:01.422960 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:01.423747 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:01.436135 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.436770 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.437736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.438310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.648124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:01.661737 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ff82188a-e978-469f-9ed1-fc980bf43a4c tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.251097 Jun 15 22:17:01.670534 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 118/216] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:01 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:01.874977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:01.875894 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:01.886725 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.887339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.888337 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.888877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.961701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:01.962500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:01.966353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd1bd3a55de406d9f4b2adf35bef024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d340df02c724bee810b3f8874379cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:01.971280 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.971280 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.972397 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:01.972934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:01.981566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8e98c46c-724d-4a56-a2a7-228d4e68c96c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 200 len: 1346 microversion: 2.1 time: 0.111361 Jun 15 22:17:01.982482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 99/217] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:01 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:02.171493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:02.179865 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a5484dc8-8929-4bff-a111-5261dad438ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.223004 Jun 15 22:17:02.180456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 119/218] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:01 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:02.680918 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:02.681568 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:02.696731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:02.698368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:02.698880 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:02.699641 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:02.900857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:02.914173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a787a187-6dbe-418f-acd3-d1f592343ad7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.238043 Jun 15 22:17:02.914918 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 100/219] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:02 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:03.002433 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:03.003287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:03.010119 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.010578 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.011411 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.011847 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.030485 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] HTTP exception thrown: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Request method failure captured: Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 HTTP/1.1 Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloSjd6vjcDVpJflwvwBUdv0fmonnyKYHYXscUjUUpr26VbiUwCarysQZQtFapiJgRtl9ipavDzaW_mq8JL6zsbXfyhEpXTwauqbs8jQP_6ifLYZwZcgCrLio3oMS1pS0HrCCB5b5uvd23jEFrhJwq6K_c9oFrcyUlML6MQyLk4sRp8 Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:17:03.035972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d340df02c724bee810b3f8874379cfc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 5fd1bd3a55de406d9f4b2adf35bef024 Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.038165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'fbb59e48-8e20-4238-b880-a1052494e259'} Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:03.045275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.048660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.051071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Returning 404 to user: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:03.051071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4984e087-3126-4c96-ac74-bec6ac275653 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 404 len: 111 microversion: 2.1 time: 0.039619 Jun 15 22:17:03.051071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 120/220] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:02 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:03.199399 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:03.200452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:03.201287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:03.202727 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:03.207035 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.207479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.208257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.208688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.220790 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.221640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.222655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.223157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.223321 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] HTTP exception thrown: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Request method failure captured: Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259/os-volume_attachments HTTP/1.1 Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloSjd6vjcDVpJflwvwBUdv0fmonnyKYHYXscUjUUpr26VbiUwCarysQZQtFapiJgRtl9ipavDzaW_mq8JL6zsbXfyhEpXTwauqbs8jQP_6ifLYZwZcgCrLio3oMS1pS0HrCCB5b5uvd23jEFrhJwq6K_c9oFrcyUlML6MQyLk4sRp8 Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:17:03.228463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d340df02c724bee810b3f8874379cfc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 5fd1bd3a55de406d9f4b2adf35bef024 Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.230047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'server_id': 'fbb59e48-8e20-4238-b880-a1052494e259'} Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:03.230876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:03.232000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:03.233223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Returning 404 to user: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:03.233223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-44f13c16-f448-4c5f-abb6-25c333c5efa7 tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034821 Jun 15 22:17:03.237479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 101/221] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:17:03 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:03.453298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:03.464550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd838050-59db-45e4-a263-1a0ef62a072b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.267727 Jun 15 22:17:03.465602 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 121/222] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:03 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:03.931800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:03.932430 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:03.940321 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.940771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:03.941647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:03.942282 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.091919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:04.097285 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:04.105960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2269422a-0da0-441f-b7e9-c703a0a6075b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.177801 Jun 15 22:17:04.107796 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 102/223] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:03 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:04.485968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:04.487399 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:04.494614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.495157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.496289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.497088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.543914 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:04.544570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:04.553638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.554241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.556373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.556373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.575497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] HTTP exception thrown: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Request method failure captured: Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 HTTP/1.1 Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloSjd6vjcDVpJflwvwBUdv0fmonnyKYHYXscUjUUpr26VbiUwCarysQZQtFapiJgRtl9ipavDzaW_mq8JL6zsbXfyhEpXTwauqbs8jQP_6ifLYZwZcgCrLio3oMS1pS0HrCCB5b5uvd23jEFrhJwq6K_c9oFrcyUlML6MQyLk4sRp8 Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:17:04.578118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d340df02c724bee810b3f8874379cfc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 5fd1bd3a55de406d9f4b2adf35bef024 Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.579611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'fbb59e48-8e20-4238-b880-a1052494e259'} Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:04.580819 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.581966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.584278 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Returning 404 to user: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:04.585530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-123f1b9e-d5d4-49c7-a014-7e9c487f772d tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 404 len: 111 microversion: 2.1 time: 0.047050 Jun 15 22:17:04.586852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 103/224] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:17:04 2022] DELETE /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 22:17:04.597088 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:04.597855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] [instance: fbb59e48-8e20-4238-b880-a1052494e259] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:04.606827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.607397 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.608718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.609475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.639148 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] HTTP exception thrown: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Request method failure captured: Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 HTTP/1.1 Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloSjd6vjcDVpJflwvwBUdv0fmonnyKYHYXscUjUUpr26VbiUwCarysQZQtFapiJgRtl9ipavDzaW_mq8JL6zsbXfyhEpXTwauqbs8jQP_6ifLYZwZcgCrLio3oMS1pS0HrCCB5b5uvd23jEFrhJwq6K_c9oFrcyUlML6MQyLk4sRp8 Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:17:04.640941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d340df02c724bee810b3f8874379cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d340df02c724bee810b3f8874379cfc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 0d340df02c724bee810b3f8874379cfc Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794795623 Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 5fd1bd3a55de406d9f4b2adf35bef024 Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-DeleteServersTestJSON-1794795623-project Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.642448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'fbb59e48-8e20-4238-b880-a1052494e259'} Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:04.643092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. Jun 15 22:17:04.647901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:17:04.649991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] Returning 404 to user: Instance fbb59e48-8e20-4238-b880-a1052494e259 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:04.649991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d4896a8c-cec4-4590-8272-f673de1d5d7c tempest-DeleteServersTestJSON-1794795623 tempest-DeleteServersTestJSON-1794795623-project] 10.222.0.55 "GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259" status: 404 len: 111 microversion: 2.1 time: 0.050207 Jun 15 22:17:04.649991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 104/225] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:04 2022] GET /compute/v2.1/servers/fbb59e48-8e20-4238-b880-a1052494e259 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:04.649991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-5b721765-663c-4288-aabc-aad0ac122dea req-1d9ce977-83c1-4371-9d2b-99e800025d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc63399-177f-412a-9000-adee5a743df6", "name": "network-vif-plugged", "status": "completed", "tag": "a8f0becc-e113-4c39-80a3-e6accfa8ceaf"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:04.662142 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5b721765-663c-4288-aabc-aad0ac122dea req-1d9ce977-83c1-4371-9d2b-99e800025d55 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:04.662598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5b721765-663c-4288-aabc-aad0ac122dea req-1d9ce977-83c1-4371-9d2b-99e800025d55 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:04.676192 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-5b721765-663c-4288-aabc-aad0ac122dea req-1d9ce977-83c1-4371-9d2b-99e800025d55 service nova] Creating event network-vif-plugged:a8f0becc-e113-4c39-80a3-e6accfa8ceaf for instance acc63399-177f-412a-9000-adee5a743df6 on hv-cinder-83538 Jun 15 22:17:04.682178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-5b721765-663c-4288-aabc-aad0ac122dea req-1d9ce977-83c1-4371-9d2b-99e800025d55 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036936 Jun 15 22:17:04.682942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 105/226] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:04.789041 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:04.799371 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1560a4b3-06ac-4ca3-b515-ea990e42abe8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.319986 Jun 15 22:17:04.801370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 122/227] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:04 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:05.135165 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:05.136475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:05.145858 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:05.146300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:05.147090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:05.147555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:05.511760 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:05.520291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fac06694-4b95-434a-bbbd-85fd69c315f6 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.391888 Jun 15 22:17:05.520885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 106/228] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:05 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:05.818816 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:05.819513 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:05.826765 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:05.827312 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:05.828893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:05.829360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:06.013638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:06.025274 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4930ef3d-ec01-433e-b553-0832abb0bb10 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.211896 Jun 15 22:17:06.026496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 123/229] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:05 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:06.539892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:06.541379 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:06.554341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:06.557504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:06.558670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:06.561271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:06.912685 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:06.926012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-52c7191b-58fc-42fc-9360-fb20f9fc0dd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.390687 Jun 15 22:17:06.927237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 107/230] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:06 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:07.042929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:07.043755 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:07.051042 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:07.051509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:07.052333 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:07.053090 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:07.217223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:07.225236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-308af6cb-4788-45bd-b4a9-1f82161afb02 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.186126 Jun 15 22:17:07.225879 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 124/231] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:07 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:07.943840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:07.944414 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:07.952503 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:07.952956 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:07.953986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:07.955221 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:08.250387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:08.251603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:08.268486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:08.269786 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:08.277061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:08.278281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:08.306127 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:08.317963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fe28a801-05bf-47f2-919b-51a82361a035 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.378026 Jun 15 22:17:08.318680 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 108/232] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:07 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:08.529408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:08.540127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-adebf557-3e41-437a-9d52-a74653cde10b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.297541 Jun 15 22:17:08.549574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 125/233] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:08 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:09.340906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:09.341542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:09.349603 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:09.350066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:09.351087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:09.351713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:09.510079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:09.519070 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c845a478-d1d1-423d-8f22-5298516496e4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1315 microversion: 2.1 time: 0.182127 Jun 15 22:17:09.519821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 109/234] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:09 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:09.560970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:09.562294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:09.570538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:09.571127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:09.571989 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:09.572943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:09.606716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:09.775517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:09.785897 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-80e74e0c-32b4-4ae7-84e9-007b4347ef5b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.230129 Jun 15 22:17:09.785897 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 126/235] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:09 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:10.536464 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:10.537128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:10.543750 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.544227 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.544988 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.545692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.695048 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:10.703960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a4492b0-56cb-43f7-8217-5377a7492bd7 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1465 microversion: 2.1 time: 0.171328 Jun 15 22:17:10.704546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 110/236] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:10 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:10.753845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:10.754428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:10.760643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.761166 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.761964 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.762447 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.789826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:17:10.808513 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:10.810066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:10.819240 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.820078 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.821644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.822296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.894805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=80 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:10.934656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-09742052-340b-458f-adbc-2142026bf096 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "DELETE /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 204 len: 0 microversion: 2.1 time: 0.184136 Jun 15 22:17:10.935444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 127/237] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:17:10 2022] DELETE /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:17:10.944947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:10.945745 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:10.952663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.953196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:10.954072 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:10.954722 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:11.010921 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:11.019435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-127e53a3-9c2d-4500-8bf1-2f4e55d719e2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.217407 Jun 15 22:17:11.020283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 111/238] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:10 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:11.144333 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:11.152817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e4cb5ebb-00f8-4890-9b03-4c6258b3bee4 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1471 microversion: 2.1 time: 0.211957 Jun 15 22:17:11.153721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 128/239] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:10 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:12.040114 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-440939293", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "networks": [{"uuid": "b1f08f80-fccf-477a-aaf3-18a5aef794df"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:12.042059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:12.042668 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:12.051787 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:12.052420 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:12.053965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:12.054539 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:12.120834 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] validate_networks() for [('b1f08f80-fccf-477a-aaf3-18a5aef794df', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:17:12.291008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:12.304812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1babb232-8b00-4690-ac05-60570d55dbac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.268703 Jun 15 22:17:12.311527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 112/240] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:12 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:12.335374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:12.335987 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:12.364521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:12.365249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:12.366861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:12.370419 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:12.717681 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:17:12.718163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:17:12.718683 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:17:12.719138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:17:12.719735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:17:12.734227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:12.734750 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:12.737475 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:12.737844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:12.760392 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:12.770052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Getting quotas for project f8635efdd4ea406eabfb397bdfd83d07. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:12.771139 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7cb13410-1f2a-4377-90c4-f6e67f1d5133 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1471 microversion: 2.1 time: 0.458238 Jun 15 22:17:12.771795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 113/241] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:12 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1471 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:12.775442 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Getting quotas for user 3955b4cf3ef54207b09d7008906221e7 and project f8635efdd4ea406eabfb397bdfd83d07. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:12.789462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:17:12.792380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:17:12.853737 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-00eef53b-9b1b-4c86-a76e-e6f841473236 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817298 Jun 15 22:17:12.854730 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 129/242] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:17:12.864671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-15dc0435-a30c-4b1a-91f8-36af9c36713b tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:12.865313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-15dc0435-a30c-4b1a-91f8-36af9c36713b tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:12.876851 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:12.942745 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-15dc0435-a30c-4b1a-91f8-36af9c36713b tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:12.951738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-15dc0435-a30c-4b1a-91f8-36af9c36713b tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1213 microversion: 2.1 time: 0.090846 Jun 15 22:17:12.952300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 114/243] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:12 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:13.332898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:13.335092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:13.345654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:13.346664 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:13.347826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:13.349856 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:13.517287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:13.527202 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d1f04820-0884-4317-ab77-cdff7d70e8e3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.200325 Jun 15 22:17:13.528144 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 130/244] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:13 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:13.789730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:13.790349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:13.812130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:13.813623 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:13.814423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:13.816768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:13.969366 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:13.970224 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:13.984116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:13.985926 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:13.994487 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:13.995211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:14.118761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:14.165772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1621e298-82e9-4da5-be62-944a84d8b773 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1265 microversion: 2.1 time: 0.196349 Jun 15 22:17:14.166437 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 131/245] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:13 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:14.513924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:14.544031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:14.544652 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:14.552453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cf3df1fa-fc88-448c-a923-eb737e3c775b tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1471 microversion: 2.1 time: 0.765325 Jun 15 22:17:14.558650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 115/246] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:13 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1471 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:14.574685 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-d4bbe0ee-d488-4438-862c-cf6b93b704f8 req-8ca70a1c-5133-4a82-8435-10e733ab88bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc63399-177f-412a-9000-adee5a743df6", "name": "network-vif-deleted", "tag": "a8f0becc-e113-4c39-80a3-e6accfa8ceaf"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:14.589244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:14.590437 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:14.593807 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:14.594590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:14.597262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-d4bbe0ee-d488-4438-862c-cf6b93b704f8 req-8ca70a1c-5133-4a82-8435-10e733ab88bc service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:14.598002 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-d4bbe0ee-d488-4438-862c-cf6b93b704f8 req-8ca70a1c-5133-4a82-8435-10e733ab88bc service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:14.636635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-d4bbe0ee-d488-4438-862c-cf6b93b704f8 req-8ca70a1c-5133-4a82-8435-10e733ab88bc service nova] Creating event network-vif-deleted:a8f0becc-e113-4c39-80a3-e6accfa8ceaf for instance acc63399-177f-412a-9000-adee5a743df6 on hv-cinder-83538 Jun 15 22:17:14.657927 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-d4bbe0ee-d488-4438-862c-cf6b93b704f8 req-8ca70a1c-5133-4a82-8435-10e733ab88bc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092030 Jun 15 22:17:14.663328 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 116/247] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:15.191018 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:15.193602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:15.204269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:15.205050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:15.206214 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:15.206989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:15.208101 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:15.219857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ce396ad7-acbc-43cb-ba7d-bb5ba37adf91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.677540 Jun 15 22:17:15.229150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 132/248] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:14 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:15.307167 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:15.316152 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-955986cc-98cd-41b5-8c49-bc6d84b39197 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1271 microversion: 2.1 time: 0.135905 Jun 15 22:17:15.326384 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 117/249] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:15 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:15.589094 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:15.590563 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:15.598883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:15.600131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:15.601192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:15.601767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:15.638106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:15.638936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:15.639603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lazy-loading 'fault' on Instance uuid acc63399-177f-412a-9000-adee5a743df6 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:17:15.701773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:15.713695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7856afdf-16c5-4f3e-ad92-34101cb21daf tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1305 microversion: 2.1 time: 0.130800 Jun 15 22:17:15.725935 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 133/250] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:15 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1305 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:16.237245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:16.247521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:16.258885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.259429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.260313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.260859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.334002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:16.336529 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:16.343882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.344651 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.345749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.346673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.435364 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:16.446118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7e690b0c-8183-400a-aa0f-3595e6ef210c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.213413 Jun 15 22:17:16.446711 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 118/251] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:16 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:16.645383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:16.654447 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e39b9053-a37b-4a7b-8b74-5c300043ae3e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.324161 Jun 15 22:17:16.655027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 134/252] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:16 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:16.733909 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:16.734523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:16.744654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.745105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.745961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.746556 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.795516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:16.795968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:16.796437 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lazy-loading 'fault' on Instance uuid acc63399-177f-412a-9000-adee5a743df6 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:17:16.853852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:16.863206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ed9c58b9-44fc-4e1b-8448-2812dec9fd30 tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1305 microversion: 2.1 time: 0.133384 Jun 15 22:17:16.865019 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 119/253] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:16 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1305 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:17.376714 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4ec02f6b-181e-4976-a1af-e119f0785283 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'create', calling method: .version_select at 0x7f99db56d8b0>, body: {"keypair": {"name": "tempest-keypair-609741064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8HwpSCfrXLo5yXHjrTHYCjdOaezNtxZ9tJKXWlhNfUy3aOoOf5uKh+QZRP9P/i/YU2UuR7ON58CkNjMlpS4Y6Li+Si+mVs9iniO/4AZJKcmiPw5R65msyalcC+MIi8/A=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:17.391247 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-4ec02f6b-181e-4976-a1af-e119f0785283 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for project 1593797d34a04b169379da1a51e18072. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:17.395761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-4ec02f6b-181e-4976-a1af-e119f0785283 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for user 97aa07a49016448d9b1067ce0dbd8d99 and project 1593797d34a04b169379da1a51e18072. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:17.425146 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4ec02f6b-181e-4976-a1af-e119f0785283 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.227345 Jun 15 22:17:17.426010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 135/254] 10.222.0.55 () {62 vars in 1199 bytes} [Wed Jun 15 22:17:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 229 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 22:17:17.466027 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:17.467282 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:17.475024 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.476340 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.477520 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.478070 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.671933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:17.672567 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:17.679897 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.680353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.685164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.685841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.699586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:17.709533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-760a6ded-1dab-4e7f-bc09-fbeb96e13882 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.246741 Jun 15 22:17:17.710538 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 120/255] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:17 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:17.881209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:17.882179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:17.889870 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.890637 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.891731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.892354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.921637 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:17.941768 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-155a1406-a263-4653-8fb4-6768ec0be0b8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.273882 Jun 15 22:17:17.942345 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:17.951534 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 136/256] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:17 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:17.951791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:17.951791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lazy-loading 'fault' on Instance uuid acc63399-177f-412a-9000-adee5a743df6 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:17:18.020493 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a20070eef754e669bcdbcc83fd44a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9143eb19784ee68d32ba580bc47797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:18.034044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c83811db-9429-41b8-a6e4-67268752670e tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 200 len: 1305 microversion: 2.1 time: 0.157622 Jun 15 22:17:18.034661 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 121/257] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:17 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 1305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:18.733921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:18.734839 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:18.760266 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:18.763252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:18.766316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:18.769136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:18.842421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-737a5c45-a4ff-4510-adf1-177d5be2512a req-904f1f9f-b5a4-45b6-91b1-0201492e023d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4e2549-4010-4b25-a126-45dc35eab7cd", "tag": "4a060def-0120-4156-b0cd-de5bdd97d326"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:18.886584 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-737a5c45-a4ff-4510-adf1-177d5be2512a req-904f1f9f-b5a4-45b6-91b1-0201492e023d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:18.887138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-737a5c45-a4ff-4510-adf1-177d5be2512a req-904f1f9f-b5a4-45b6-91b1-0201492e023d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:18.963470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-737a5c45-a4ff-4510-adf1-177d5be2512a req-904f1f9f-b5a4-45b6-91b1-0201492e023d service nova] Creating event network-changed:4a060def-0120-4156-b0cd-de5bdd97d326 for instance 4a4e2549-4010-4b25-a126-45dc35eab7cd on hv-cinder-83538 Jun 15 22:17:18.986518 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-737a5c45-a4ff-4510-adf1-177d5be2512a req-904f1f9f-b5a4-45b6-91b1-0201492e023d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143877 Jun 15 22:17:18.989024 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 122/258] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:17:19.004163 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:19.005848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:19.015665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:19.016645 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:19.017771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:19.018892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:19.041555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:19.285017 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:19.293373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-822e887e-4190-4a2d-911e-6fa38071eb75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.568496 Jun 15 22:17:19.294749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 137/259] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:18 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:19.299878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:19.300709 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] [instance: acc63399-177f-412a-9000-adee5a743df6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:19.307868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:19.308682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:19.310295 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:19.310930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:19.327325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] HTTP exception thrown: Instance acc63399-177f-412a-9000-adee5a743df6 could not be found. Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Request method failure captured: Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 HTTP/1.1 Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlpI3pYlsMvQuspQKEzKJhcpMp9L6CFhzL3gdxvAtHtscYqD5NU_rn0iRC9GnMsFi7iGOsH_sfMMROZcZQJT7M_fEeZGDnmrH8THrLid58cazdpcyG5LjjG5CfozHWWFjJuOCchvXAm-lmnDGpMaHdmldNNcuCd2oG5MvsPaAfIQRps Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 4b9143eb19784ee68d32ba580bc47797 Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-344653640 Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:17:19.329435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4b9143eb19784ee68d32ba580bc47797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4b9143eb19784ee68d32ba580bc47797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4b9143eb19784ee68d32ba580bc47797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4b9143eb19784ee68d32ba580bc47797", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-344653640 Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 4b9143eb19784ee68d32ba580bc47797 Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-344653640 Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-344653640-project Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 9a20070eef754e669bcdbcc83fd44a5c Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-344653640-project Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance acc63399-177f-412a-9000-adee5a743df6 could not be found. Jun 15 22:17:19.330609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'acc63399-177f-412a-9000-adee5a743df6'} Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc63399-177f-412a-9000-adee5a743df6 could not be found. Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:19.331263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc63399-177f-412a-9000-adee5a743df6 could not be found. Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc63399-177f-412a-9000-adee5a743df6 could not be found. Jun 15 22:17:19.332417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:19.335227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] Returning 404 to user: Instance acc63399-177f-412a-9000-adee5a743df6 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:19.336587 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a16b5dee-2a9b-4dd4-87f5-0be30ad945de tempest-VolumesNegativeTest-344653640 tempest-VolumesNegativeTest-344653640-project] 10.222.0.55 "GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6" status: 404 len: 111 microversion: 2.1 time: 0.040317 Jun 15 22:17:19.337585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 138/260] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:19 2022] GET /compute/v2.1/servers/acc63399-177f-412a-9000-adee5a743df6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:19.527615 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:19.539063 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-55f58768-9849-406c-a255-e782d597b4ac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.543670 Jun 15 22:17:19.542915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 123/261] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:18 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:20.046933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-914617701", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30f8706e-cb6c-4f5e-8770-dbd4a3aa4e2e"}], "security_groups": [{"name": "tempest-securitygroup--395114982"}], "key_name": "tempest-keypair-609741064", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:20.183057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] validate_networks() for [('30f8706e-cb6c-4f5e-8770-dbd4a3aa4e2e', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:17:20.311616 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:20.313924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:20.330837 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:20.331237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:20.332053 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:20.333152 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:20.616094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:20.626328 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0f17d170-b9a8-4243-b9dc-f3688f31c72f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.319321 Jun 15 22:17:20.638123 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 124/262] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:20 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:20.649529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:20.650466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:20.662639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:20.663093 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:20.664073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:20.664682 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:20.759744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:17:20.760293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:17:20.760984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:17:20.761728 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:17:20.762830 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:17:20.799410 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:20.799852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:20.800661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:20.801112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:20.824568 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for project 1593797d34a04b169379da1a51e18072. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:20.830858 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for user 97aa07a49016448d9b1067ce0dbd8d99 and project 1593797d34a04b169379da1a51e18072. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:20.845749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:17:20.848259 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:17:20.920498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:20.928852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d2bc5b88-60d4-476d-bbca-1eb116972b7a tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.283954 Jun 15 22:17:20.929846 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 125/263] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:20 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:20.930086 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dc0cc4a6-2a36-4793-bd4c-ff547d5c9180 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.888795 Jun 15 22:17:20.931852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 139/264] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Jun 15 22:17:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 22:17:20.944185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c06944b5-2cd3-4e30-8bc0-6f0309c3df7c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:20.946300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c06944b5-2cd3-4e30-8bc0-6f0309c3df7c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:21.098740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c06944b5-2cd3-4e30-8bc0-6f0309c3df7c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:21.112952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c06944b5-2cd3-4e30-8bc0-6f0309c3df7c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:21.119039 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c06944b5-2cd3-4e30-8bc0-6f0309c3df7c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:21.122255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c06944b5-2cd3-4e30-8bc0-6f0309c3df7c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1280 microversion: 2.20 time: 0.182173 Jun 15 22:17:21.129494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 126/265] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:20 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:21.644122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:21.644732 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:21.651391 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:21.651829 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:21.652715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:21.653291 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:21.947426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:21.947914 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:21.961010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:21.962206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:21.963896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:21.965710 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:21.995779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:22.004722 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd29bd62-8863-4a70-9cfe-cb11b658322b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.364908 Jun 15 22:17:22.010843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 140/266] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:21 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:22.141233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:22.142103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:22.152635 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:22.155689 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:22.160686 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:22.161217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:22.259619 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:22.273548 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c5646195-9293-4d07-a934-f1b78fcaf2a3 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.330801 Jun 15 22:17:22.274849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 127/267] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:21 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:22.300477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:22.312490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:22.315236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:22.316398 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-417a05cc-002c-4b13-a510-442e85c988e2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1332 microversion: 2.20 time: 0.180393 Jun 15 22:17:22.317370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 141/268] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:22 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:17:23.024530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:23.025559 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:23.034651 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:23.035190 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:23.036062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:23.036563 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:23.292267 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:23.293683 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:23.302600 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:23.303366 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:23.304364 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:23.305657 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:23.306847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:23.317557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b4b59b98-d46a-4e1d-a8bb-e2cba63497ff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.298573 Jun 15 22:17:23.321153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 128/269] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:23 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:23.341449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:23.341449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:23.351812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:23.360627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:23.361839 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:23.361958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:23.509753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:23.528159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:23.529949 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:23.531117 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9d426531-6995-4bb7-963d-e97455cb1d70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1338 microversion: 2.20 time: 0.200662 Jun 15 22:17:23.532061 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 129/270] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:23 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:17:23.694612 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:23.709368 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ab23deef-7b52-4608-b24b-bb2628bedce8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.421173 Jun 15 22:17:23.711013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 142/271] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:23 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:24.061801 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-b6dccfa7-8abf-44d7-9818-b1f88784ec29 req-d3743408-9cc8-4ffc-9501-471fdcaaddf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e2549-4010-4b25-a126-45dc35eab7cd", "name": "network-vif-plugged", "status": "completed", "tag": "4a060def-0120-4156-b0cd-de5bdd97d326"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:24.102163 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b6dccfa7-8abf-44d7-9818-b1f88784ec29 req-d3743408-9cc8-4ffc-9501-471fdcaaddf5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.103201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b6dccfa7-8abf-44d7-9818-b1f88784ec29 req-d3743408-9cc8-4ffc-9501-471fdcaaddf5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.129466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-b6dccfa7-8abf-44d7-9818-b1f88784ec29 req-d3743408-9cc8-4ffc-9501-471fdcaaddf5 service nova] Creating event network-vif-plugged:4a060def-0120-4156-b0cd-de5bdd97d326 for instance 4a4e2549-4010-4b25-a126-45dc35eab7cd on hv-cinder-83538 Jun 15 22:17:24.138452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-b6dccfa7-8abf-44d7-9818-b1f88784ec29 req-d3743408-9cc8-4ffc-9501-471fdcaaddf5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098126 Jun 15 22:17:24.139064 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 130/272] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:24.340450 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:24.342728 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:24.350748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.351444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.352828 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.353444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.550394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:24.551293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:24.558087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.558992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.560958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.561594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.628084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:24.632835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:24.656044 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8e31d384-c7dc-415e-ade1-61b74294d4f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.324274 Jun 15 22:17:24.658059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 143/273] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:24 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:24.728771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:24.729551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:24.737487 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.737943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.738718 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:24.739149 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:24.887304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:24.897357 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:24.903323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:24.904552 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e21a6678-c284-4d8a-b19f-ec12ea5e5be1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.358405 Jun 15 22:17:24.905077 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 131/274] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:24 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:17:24.939717 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:24.950353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b5cf36e3-13d4-4fcc-8ba8-bbef333af8a8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1313 microversion: 2.1 time: 0.225827 Jun 15 22:17:24.961365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 144/275] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:24 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:25.258889 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-0ee6c507-3167-43a9-8f93-e7c5a1d8e396 req-cfdde739-75f4-451c-90a1-25172ba50c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:25.276636 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0ee6c507-3167-43a9-8f93-e7c5a1d8e396 req-cfdde739-75f4-451c-90a1-25172ba50c5d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:25.278335 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0ee6c507-3167-43a9-8f93-e7c5a1d8e396 req-cfdde739-75f4-451c-90a1-25172ba50c5d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:25.292742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-0ee6c507-3167-43a9-8f93-e7c5a1d8e396 req-cfdde739-75f4-451c-90a1-25172ba50c5d service nova] Creating event network-changed:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:17:25.298232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-0ee6c507-3167-43a9-8f93-e7c5a1d8e396 req-cfdde739-75f4-451c-90a1-25172ba50c5d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050427 Jun 15 22:17:25.299374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 132/276] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:25.677876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:25.678611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:25.688590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:25.689046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:25.690133 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:25.690573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:25.923885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:25.924882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:25.932243 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:25.933076 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:25.934212 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:25.935126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:26.090950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:26.099081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3f36c1ff-523f-4a2d-971f-28d1ee3f66cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.426719 Jun 15 22:17:26.109603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 145/277] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:25 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:26.114685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:26.115576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:26.123198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:26.123380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:26.124351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:26.124832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:26.474256 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:26.497016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:26.500618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:26.505022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fc2fb477-6497-48fa-8f98-d761010013c0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.585014 Jun 15 22:17:26.506425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 133/278] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:25 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:26.779410 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:26.802886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-32a0b2b6-94aa-4fad-b88d-b6134ecd1aac tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1497 microversion: 2.1 time: 0.691887 Jun 15 22:17:26.808291 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 146/279] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:26 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1497 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:27.117010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:27.118062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:27.148384 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.150377 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.154147 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.154604 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.506849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:27.516553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-854102be-67eb-4b2f-a36b-33302d5d7b37 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.403236 Jun 15 22:17:27.517672 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 134/280] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:27 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:27.536863 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:27.537314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:27.538109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:27.539594 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:27.545558 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.546126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.546917 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.547349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.548058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.549301 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.550477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.551138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.585867 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:17:27.720248 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f8c7e92e-54fa-4d7e-9366-694d664659cc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 204 len: 0 microversion: 2.1 time: 0.187321 Jun 15 22:17:27.720957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 147/281] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:17:27 2022] DELETE /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:17:27.730322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:27.731305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:27.738606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.739173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.740032 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:27.740535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:27.851474 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:27.865271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:27.873151 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:27.875477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-93b439ae-a884-45fb-b6c0-23fd97b2094e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.343020 Jun 15 22:17:27.879202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 135/282] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:27 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:27.916963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:27.966752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d314f8fe-b08b-46d3-a258-85caf6a2c9d4 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1503 microversion: 2.1 time: 0.238328 Jun 15 22:17:27.978819 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 148/283] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:27 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:28.542179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:28.542179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:28.551888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:28.552406 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:28.553185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:28.553650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:28.714689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:28.722949 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c85a9239-cc5b-4c54-99af-1c1c62460ff0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.191781 Jun 15 22:17:28.723569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 136/284] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:28 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:28.896671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:28.897271 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:28.903622 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:28.904068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:28.904846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:28.905262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:28.986133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:28.986738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:28.995383 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:28.996010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:28.997651 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:28.998242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:29.070972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:29.081403 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:29.082910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:29.084066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1b6b8539-6c92-42f2-91af-39b42a54d397 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.191554 Jun 15 22:17:29.084619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 149/285] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:28 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:29.327495 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:29.337614 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-26620460-c28d-4a6a-b36b-5bffa047c6a1 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1503 microversion: 2.1 time: 0.356084 Jun 15 22:17:29.349533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 137/286] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:28 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:29.621367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-469526187", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "networks": [{"uuid": "9200866c-5ebf-4743-a4b5-3b5987ff8333"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:29.679220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] validate_networks() for [('9200866c-5ebf-4743-a4b5-3b5987ff8333', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:17:29.741023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:29.741761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:29.749631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:29.750166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:29.751230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:29.751740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:29.932612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:29.942299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-71b322ae-f35e-4215-8baa-0a7e8bb5cde2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.205074 Jun 15 22:17:29.943228 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 138/287] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:29 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:30.108084 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:30.108937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:30.118798 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.119294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.121036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.121036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.185044 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:17:30.186120 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:17:30.186120 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:17:30.186610 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:17:30.187045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:17:30.189576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:30.205003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.205575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.206382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.206803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.231528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Getting quotas for project 1c2773d61c84492fb70a7a59cffa6fdb. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:30.236626 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Getting quotas for user c603735d259e4ea390006779d4e76575 and project 1c2773d61c84492fb70a7a59cffa6fdb. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:30.261848 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:17:30.265536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:17:30.310892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:30.321645 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:30.323704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:30.325226 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c0850942-dfd8-4777-86cf-64101181faed tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708349 Jun 15 22:17:30.325602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dfe62b7c-fe9f-40d9-a25b-54f0e5ad185b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.221290 Jun 15 22:17:30.326054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 150/288] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:17:30.330208 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 139/289] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:30 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:30.339462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b0126aa7-1998-4441-a693-e4a5d275f937 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:30.341971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b0126aa7-1998-4441-a693-e4a5d275f937 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:30.358984 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:30.359761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:30.367875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.368415 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.369520 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.370031 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.406903 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b0126aa7-1998-4441-a693-e4a5d275f937 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:30.418041 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b0126aa7-1998-4441-a693-e4a5d275f937 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1218 microversion: 2.1 time: 0.085039 Jun 15 22:17:30.419173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 151/290] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:30 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:30.612068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:30.622541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fc6dec60-21bd-4e8f-812d-4a19667c34a2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1503 microversion: 2.1 time: 0.269665 Jun 15 22:17:30.623365 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 140/291] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:30 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:30.976455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:30.976847 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:30.993116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.994875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:30.995710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:30.996888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.324155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:31.334742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7fce280f-f067-4569-9533-5a92838cf0ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.366874 Jun 15 22:17:31.337374 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 152/292] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:30 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:31.358862 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:31.359510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:31.362606 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:31.374836 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.375293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.376091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.376797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.417577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-fc8d4519-b4e0-4ec4-99df-f55350077dec req-78e99805-56e4-4cc5-956f-01bb0ce7c55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e2549-4010-4b25-a126-45dc35eab7cd", "name": "network-vif-deleted", "tag": "4a060def-0120-4156-b0cd-de5bdd97d326"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:31.431673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-fc8d4519-b4e0-4ec4-99df-f55350077dec req-78e99805-56e4-4cc5-956f-01bb0ce7c55d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.432985 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-fc8d4519-b4e0-4ec4-99df-f55350077dec req-78e99805-56e4-4cc5-956f-01bb0ce7c55d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.469863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-fc8d4519-b4e0-4ec4-99df-f55350077dec req-78e99805-56e4-4cc5-956f-01bb0ce7c55d service nova] Creating event network-vif-deleted:4a060def-0120-4156-b0cd-de5bdd97d326 for instance 4a4e2549-4010-4b25-a126-45dc35eab7cd on hv-cinder-83538 Jun 15 22:17:31.475459 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-fc8d4519-b4e0-4ec4-99df-f55350077dec req-78e99805-56e4-4cc5-956f-01bb0ce7c55d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063467 Jun 15 22:17:31.476893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 153/293] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:17:31.483888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:31.484720 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:31.492639 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.493289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.494678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.495309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.578295 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:31.591677 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-590ead8c-db38-4221-ab11-6ff6b0f89492 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1214 microversion: 2.1 time: 0.113189 Jun 15 22:17:31.592675 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 154/294] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:31 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:31.603106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:31.630220 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:31.635915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:31.637358 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d6d06215-06c2-4192-8cd8-a9f7686ed9bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.282612 Jun 15 22:17:31.639337 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 141/295] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:31 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:31.646393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:31.647463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:31.663766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.664227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.665902 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.666629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.716452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:31.716895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:31.717370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lazy-loading 'fault' on Instance uuid 4a4e2549-4010-4b25-a126-45dc35eab7cd {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:17:31.765610 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:31.776272 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a3818082-1566-4eb2-a7a4-7cbacfdebf63 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 200 len: 1303 microversion: 2.1 time: 0.137287 Jun 15 22:17:31.776862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 155/296] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:31 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:32.363036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:32.364001 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:32.370387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.370920 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.371745 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.372175 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.376569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:32.610343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:32.611663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:32.619395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.619849 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.620655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.621476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.688401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:32.695589 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:32.705695 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9137e708-6656-4ef1-b27a-4a34da988f4b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.344934 Jun 15 22:17:32.710345 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c382c19e-c622-4d2f-a5b0-ade4a8f1a38f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1276 microversion: 2.1 time: 0.104572 Jun 15 22:17:32.711217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 142/297] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:32 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:32.727079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:32.727689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:32.727959 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 156/298] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:32 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:32.735804 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.736449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.737417 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.738033 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.794705 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:32.795316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 4a4e2549-4010-4b25-a126-45dc35eab7cd] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:32.801836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.802285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.803058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:32.803488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:32.822855 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] HTTP exception thrown: Instance 4a4e2549-4010-4b25-a126-45dc35eab7cd could not be found. Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Request method failure captured: Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd HTTP/1.1 Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlph0UGA2NAKFdvSpGve5Gpf4ehi0IzrlhR9lk7bt7xyiK8u52nJ9Cjz78DDDEJrE4R4aL7Y2eMOA3nHgtUqcMXOZO7sCq4ZGcmMMtPOV05D7ntQYWq2OiMoXc_LKjKa-MSbKzVP6PbgvzmcnQ_3AixvSuzD5e3gw0Jfxd6ofLS1BPk Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: f8635efdd4ea406eabfb397bdfd83d07 Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesActionsTest-1318816648 Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:17:32.824688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f8635efdd4ea406eabfb397bdfd83d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f8635efdd4ea406eabfb397bdfd83d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f8635efdd4ea406eabfb397bdfd83d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f8635efdd4ea406eabfb397bdfd83d07", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesActionsTest-1318816648 Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: f8635efdd4ea406eabfb397bdfd83d07 Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesActionsTest-1318816648 Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesActionsTest-1318816648-project Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 3955b4cf3ef54207b09d7008906221e7 Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesActionsTest-1318816648-project Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 4a4e2549-4010-4b25-a126-45dc35eab7cd could not be found. Jun 15 22:17:32.826453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '4a4e2549-4010-4b25-a126-45dc35eab7cd'} Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a4e2549-4010-4b25-a126-45dc35eab7cd could not be found. Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:32.827347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a4e2549-4010-4b25-a126-45dc35eab7cd could not be found. Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a4e2549-4010-4b25-a126-45dc35eab7cd could not be found. Jun 15 22:17:32.828695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:32.829888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Returning 404 to user: Instance 4a4e2549-4010-4b25-a126-45dc35eab7cd could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:32.829888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9c31d19c-3443-4ad0-b0c2-accc8f03a295 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd" status: 404 len: 111 microversion: 2.1 time: 0.036312 Jun 15 22:17:32.829888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 157/299] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:32 2022] GET /compute/v2.1/servers/4a4e2549-4010-4b25-a126-45dc35eab7cd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 22:17:32.945830 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-232158587", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "networks": [{"uuid": "b1f08f80-fccf-477a-aaf3-18a5aef794df"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:32.999448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:33.012505 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:33.014692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:33.016119 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7fac19f8-30c4-40d6-92c0-ef74bd417ed3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.293626 Jun 15 22:17:33.017698 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 143/300] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:32 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:33.023640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] validate_networks() for [('b1f08f80-fccf-477a-aaf3-18a5aef794df', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:17:33.458158 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:17:33.459155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:17:33.459625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:17:33.460407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:17:33.461562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:17:33.471826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:33.472271 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:33.473074 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:33.473549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:33.493464 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Getting quotas for project f8635efdd4ea406eabfb397bdfd83d07. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:33.497818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Getting quotas for user 3955b4cf3ef54207b09d7008906221e7 and project f8635efdd4ea406eabfb397bdfd83d07. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:33.510052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:17:33.513065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:17:33.572201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-25ebafc1-9b51-441d-ad35-d1d79ad9b70c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630095 Jun 15 22:17:33.573187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 158/301] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:17:33.591647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a80d3e32-863d-4b66-bfce-fe80f37c00e8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:33.593060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a80d3e32-863d-4b66-bfce-fe80f37c00e8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:33.661521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a80d3e32-863d-4b66-bfce-fe80f37c00e8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:33.674442 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a80d3e32-863d-4b66-bfce-fe80f37c00e8 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1213 microversion: 2.1 time: 0.088636 Jun 15 22:17:33.678432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 144/302] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:33 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:33.744491 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:33.749876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:33.765000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:33.767943 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:33.774348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:33.777078 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:33.781923 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:33.782634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:33.787476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:33.788991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:33.792569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:33.793118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.112315 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:34.127517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1179f955-2b9d-4b65-98ab-39cdd6740459 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.400805 Jun 15 22:17:34.128926 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 159/303] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:33 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:34.147772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:34.148964 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:34.170258 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:34.170979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.172932 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:34.174789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.210564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:34.225855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aa50e992-50e1-4dc9-8745-349c1ba067c8 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.483458 Jun 15 22:17:34.226831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 145/304] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:33 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:34.232450 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-5adfa65e-b5a6-41bc-8a94-50698a0d6305 req-4fe83e5b-387a-4d2d-a366-c9ba17df624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "name": "network-vif-plugged", "status": "completed", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:34.250944 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5adfa65e-b5a6-41bc-8a94-50698a0d6305 req-4fe83e5b-387a-4d2d-a366-c9ba17df624b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:34.251340 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5adfa65e-b5a6-41bc-8a94-50698a0d6305 req-4fe83e5b-387a-4d2d-a366-c9ba17df624b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.267023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-5adfa65e-b5a6-41bc-8a94-50698a0d6305 req-4fe83e5b-387a-4d2d-a366-c9ba17df624b service nova] Creating event network-vif-plugged:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:17:34.274638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-5adfa65e-b5a6-41bc-8a94-50698a0d6305 req-4fe83e5b-387a-4d2d-a366-c9ba17df624b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046211 Jun 15 22:17:34.282399 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 146/305] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:34.403716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:34.418558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:34.421518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:34.422704 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-33d07c8c-eb7a-4233-9e0f-2faa5546958c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.292543 Jun 15 22:17:34.424464 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 160/306] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:34 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:34.696813 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:34.697602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:34.704672 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:34.705378 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.706105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:34.707111 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.790871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:34.800924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a4355f91-6caa-4854-81e7-a9190d67e28e tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1265 microversion: 2.1 time: 0.109045 Jun 15 22:17:34.801893 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 147/307] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:34 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:34.911229 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-61cbb4bc-a4db-486f-a728-5b471bed0b15 req-cf61902f-4425-4525-8065-6a38a59c5f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ced019-d078-4b0d-86c0-8fba6272c7b8", "tag": "6eceeeb6-06c6-41f7-b6c5-14f4aef9a523"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:34.921265 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-61cbb4bc-a4db-486f-a728-5b471bed0b15 req-cf61902f-4425-4525-8065-6a38a59c5f14 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:34.921819 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-61cbb4bc-a4db-486f-a728-5b471bed0b15 req-cf61902f-4425-4525-8065-6a38a59c5f14 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:34.935085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-61cbb4bc-a4db-486f-a728-5b471bed0b15 req-cf61902f-4425-4525-8065-6a38a59c5f14 service nova] Creating event network-changed:6eceeeb6-06c6-41f7-b6c5-14f4aef9a523 for instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 on hv-cinder-83538 Jun 15 22:17:34.940623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-61cbb4bc-a4db-486f-a728-5b471bed0b15 req-cf61902f-4425-4525-8065-6a38a59c5f14 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Jun 15 22:17:34.941612 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 161/308] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:35.144905 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:35.146478 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:35.153146 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.154558 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.155636 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.156230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.244114 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:35.244817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:35.251527 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.252187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.252931 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.253643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.320355 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:35.330582 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-750689b6-ed29-49b9-af57-dbf30034ba0a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1521 microversion: 2.1 time: 0.190053 Jun 15 22:17:35.331469 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 148/309] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:35 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:35.398417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:35.401979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:35.408282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-749ac6fd-d499-4bc7-9070-8faeb974e819 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.168308 Jun 15 22:17:35.408849 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 162/310] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:35 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:35.439992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:35.440601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:35.446779 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.447221 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.447986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.448416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.588101 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:35.596535 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:35.598063 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:35.599189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-da4462ab-3c7e-42ae-b85f-9bbd260368af tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.163107 Jun 15 22:17:35.599762 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 149/311] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:35 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:35.821759 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:35.822551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:35.833003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.833643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.834458 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:35.834925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:35.902155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:35.911498 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5baae8cb-4337-4b48-a185-841afba14495 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1273 microversion: 2.1 time: 0.096437 Jun 15 22:17:35.912924 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 163/312] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:35 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:36.347816 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:36.348426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:36.355656 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.356172 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.356945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.357404 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.425107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:36.426518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:36.432921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.433803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.434659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.435161 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.497518 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:36.506094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e3c84b0a-1b2b-4df9-9ca6-5e472b8bb365 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1501 microversion: 2.1 time: 0.162155 Jun 15 22:17:36.506907 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 150/313] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:36 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:36.522571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:36.523220 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:36.531210 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.532051 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.532820 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.533428 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.588901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:36.596757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c28eb3b6-89ce-4fa2-8edc-6e4bba89c33c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.175695 Jun 15 22:17:36.597354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 164/314] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:36 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:36.618080 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:36.618794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:36.625360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.625986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.626758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.627188 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.695156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:36.704469 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f4d9e35f-3012-4ede-abfe-94a43498b8c3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1515 microversion: 2.1 time: 0.185344 Jun 15 22:17:36.705684 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 151/315] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:36 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:36.805834 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:36.816645 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:36.819217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:36.823042 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-04b106f8-e4aa-43de-8d2c-24a7e3e68f2d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1405 microversion: 2.20 time: 0.208225 Jun 15 22:17:36.823945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 165/316] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:36 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:17:36.930495 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:36.931098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:36.938096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.938795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:36.939935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:36.940425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:37.010773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:37.020768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8c7d0fb3-3e9a-4b61-8aa5-109f56de346d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1273 microversion: 2.1 time: 0.093920 Jun 15 22:17:37.029820 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 152/317] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:36 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:37.617707 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:37.618448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:37.626568 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:37.627022 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:37.628071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:37.628538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:37.822110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:37.838945 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a79e362e-8200-4044-9513-7ddcd62daba3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.227948 Jun 15 22:17:37.840882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 166/318] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:37 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:37.843058 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:37.843791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:37.854545 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:37.856522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:37.857973 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:37.858795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.041066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:38.042126 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:38.050418 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.051106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.051973 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.052802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.062200 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:38.071705 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:38.073637 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:38.075220 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c218e521-4b25-47ed-9f7b-f11fabfabbd5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1597 microversion: 2.20 time: 0.237510 Jun 15 22:17:38.076375 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 153/319] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:17:37 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1597 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:17:38.101790 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:38.102453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:38.109657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.110208 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.111061 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.111559 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.262053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:38.272325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-56915c93-bc13-48d3-a36c-25be0f2e5b95 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.237894 Jun 15 22:17:38.272995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 167/320] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:38 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:38.278748 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:38.280217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:38.287936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.288388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.289922 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.289922 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.317702 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'flavor' on Instance uuid eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:17:38.350505 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-880b7372-58ae-4058-9174-ef0be5165b67 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.252687 Jun 15 22:17:38.357790 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 154/321] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Jun 15 22:17:38 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:17:38.468922 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-17bbf471-290e-4e15-8acf-03df678d020f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/action" status: 200 len: 32 microversion: 2.1 time: 0.194275 Jun 15 22:17:38.469933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 168/322] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:17:38 2022] POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:17:38.479519 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:38.479724 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:38.486717 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.487479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.488366 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.488861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.858009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:38.859577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:38.866598 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.867121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.867961 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:38.868460 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:38.922270 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:38.937481 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-07ca5fb8-9393-4670-bc5b-0f34df944fd5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.460680 Jun 15 22:17:38.939014 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 155/323] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:38 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:39.110993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:39.118880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-52173482-9ead-4be8-a00f-56140310d347 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.265497 Jun 15 22:17:39.120332 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 169/324] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:38 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:39.290977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:39.294774 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:39.301945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:39.302648 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:39.303953 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:39.304618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:39.742051 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ebb8a854-4190-4838-99c2-267e91719118 req-7bc097a6-471e-4d27-96ff-3c36ec74d011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:39.758854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ebb8a854-4190-4838-99c2-267e91719118 req-7bc097a6-471e-4d27-96ff-3c36ec74d011 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:39.759907 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ebb8a854-4190-4838-99c2-267e91719118 req-7bc097a6-471e-4d27-96ff-3c36ec74d011 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:39.776514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ebb8a854-4190-4838-99c2-267e91719118 req-7bc097a6-471e-4d27-96ff-3c36ec74d011 service nova] Creating event network-changed:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:17:39.787192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ebb8a854-4190-4838-99c2-267e91719118 req-7bc097a6-471e-4d27-96ff-3c36ec74d011 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057681 Jun 15 22:17:39.788253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 170/325] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:39.821692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:39.833938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-309ae8c1-5148-408e-97b1-0dc2be090616 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.546721 Jun 15 22:17:39.834695 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 156/326] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:39 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:39.958975 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:39.960459 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:39.970839 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:39.971655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:39.972782 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:39.973442 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:40.136094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:40.137091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:40.148196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:40.150674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:40.152537 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:40.153527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:40.160308 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:40.168606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-174aa7b3-c3c9-4478-9840-488ccd7a445f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.216010 Jun 15 22:17:40.171011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 171/327] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:39 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:40.264264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-dfd0f055-d6a6-4505-9820-f385f8830f7a req-60d600ad-e2cd-4753-96ae-3de793cd20b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464578c6-8b47-4ca7-b0cb-1d64f8e495d6", "tag": "ef115d0d-bf82-4a35-b1b6-04655b8479de"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:40.273922 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-dfd0f055-d6a6-4505-9820-f385f8830f7a req-60d600ad-e2cd-4753-96ae-3de793cd20b6 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:40.274643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-dfd0f055-d6a6-4505-9820-f385f8830f7a req-60d600ad-e2cd-4753-96ae-3de793cd20b6 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:40.292023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-dfd0f055-d6a6-4505-9820-f385f8830f7a req-60d600ad-e2cd-4753-96ae-3de793cd20b6 service nova] Creating event network-changed:ef115d0d-bf82-4a35-b1b6-04655b8479de for instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 on hv-cinder-83538 Jun 15 22:17:40.301448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-dfd0f055-d6a6-4505-9820-f385f8830f7a req-60d600ad-e2cd-4753-96ae-3de793cd20b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041174 Jun 15 22:17:40.306455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 172/328] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:17:40.415173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:40.423792 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c35d093c-324a-4048-bd33-8ef521ed59df tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.291638 Jun 15 22:17:40.424388 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 157/329] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:40 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:40.855290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:40.856176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:40.875715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:40.881305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:40.886307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:40.887758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:41.100026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:41.109189 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0f28af8a-5e0e-42a1-9034-a4c35434cb1c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.260478 Jun 15 22:17:41.110888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 173/330] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:40 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:41.188407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:41.189208 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:41.197151 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:41.197721 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:41.198613 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:41.199166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:41.440886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:41.441822 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:41.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:41.451293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:41.452423 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:41.453105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:41.547591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:41.559387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-38aab20f-2e16-4372-81d7-bb2ba6ac8ef5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.375588 Jun 15 22:17:41.560242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 158/331] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:41 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:41.672362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:41.690914 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c687517d-6990-4e00-8092-30c4f180286c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.253712 Jun 15 22:17:41.693024 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 174/332] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:41 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:42.128339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:42.128941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:42.135633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.135979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.136854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.137290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.463679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:42.472109 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7515a487-63ee-4db1-b023-384e509fbdd9 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.348481 Jun 15 22:17:42.472706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 159/333] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:42 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:42.577689 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:42.578446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:42.585354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.585904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.586697 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.587139 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.719847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:42.720848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:42.723323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:42.730382 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.731522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.733972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.733972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.744732 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:42.759932 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e36646c-0e75-4491-aca4-c3674ceecbe9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.187128 Jun 15 22:17:42.761736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 175/334] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:42 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:42.916521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:42.923465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:42.933402 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3a49bd30-0564-4689-8416-9e2b14d04dc4 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.218738 Jun 15 22:17:42.934471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 160/335] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:42 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:42.960858 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:42.961368 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:42.970478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.970999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:42.972000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:42.972540 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:43.000313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-61b5b4dd-c7b7-47b1-92ad-9360d1e31d7e tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/ips" status: 200 len: 150 microversion: 2.1 time: 0.043474 Jun 15 22:17:43.007099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 176/336] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:17:42 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:43.490462 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:43.491095 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:43.498913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:43.499409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:43.500237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:43.500715 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:43.672235 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:43.674662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:43.682608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c0f9c415-fdae-4df5-9f5e-8ee666c2ebb6 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.196190 Jun 15 22:17:43.683258 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 161/337] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:43 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:43.778895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:43.779493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:43.783097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=8 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:43.783779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=30 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:43.790636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:43.791084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:43.791882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:43.792361 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:43.954432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:43.955431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:43.963990 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:43.964432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:43.966145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:43.966589 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:44.211787 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:44.232169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1986a95d-23b0-42dc-9866-048f5e070d51 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.280382 Jun 15 22:17:44.232169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 162/338] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:43 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:44.239490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-fe9316e1-b83d-470b-b7fc-1326c70a14e0 req-c7780330-17f3-42f5-b8a3-98c3d748eb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ced019-d078-4b0d-86c0-8fba6272c7b8", "name": "network-vif-plugged", "status": "completed", "tag": "6eceeeb6-06c6-41f7-b6c5-14f4aef9a523"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:44.248514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:44.251626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fe9316e1-b83d-470b-b7fc-1326c70a14e0 req-c7780330-17f3-42f5-b8a3-98c3d748eb37 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:44.252065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fe9316e1-b83d-470b-b7fc-1326c70a14e0 req-c7780330-17f3-42f5-b8a3-98c3d748eb37 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:44.256712 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e9c2683d-b623-49c1-8a01-98550eea5794 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.482342 Jun 15 22:17:44.257309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 177/339] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:43 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:44.274522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-fe9316e1-b83d-470b-b7fc-1326c70a14e0 req-c7780330-17f3-42f5-b8a3-98c3d748eb37 service nova] Creating event network-vif-plugged:6eceeeb6-06c6-41f7-b6c5-14f4aef9a523 for instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 on hv-cinder-83538 Jun 15 22:17:44.281590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-fe9316e1-b83d-470b-b7fc-1326c70a14e0 req-c7780330-17f3-42f5-b8a3-98c3d748eb37 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051097 Jun 15 22:17:44.282271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 163/340] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:44.701429 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:44.702045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:44.709011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:44.709872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:44.710263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:44.710687 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:44.856425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:44.864889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cca85f5d-689c-4997-8f6e-4200bad4dfdc tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.168066 Jun 15 22:17:44.865923 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 178/341] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:44 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:45.247911 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:45.248601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:45.255245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.255684 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.256467 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.256892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.278604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:45.279227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:45.286119 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.286564 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.287337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.287763 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.293214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:45.404262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:45.415725 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ecd08cca-cf4d-4d4a-825e-74428b7a0878 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1318 microversion: 2.1 time: 0.173526 Jun 15 22:17:45.416310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 164/342] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:45 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:45.463120 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:45.472416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e5ae97e9-6a46-48b8-ab84-688ebc78c50b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.201482 Jun 15 22:17:45.473344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 179/343] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:45 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:45.506808 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbb44d9c-243b-4de3-a6af-5577329f653b"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:45.507968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:45.514877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.515321 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.516097 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.516534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.643097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:45.643742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:45.651549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.651927 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.652996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.653466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.688476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9ce2db3c-c059-44a8-806f-1acb16b40592 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/ips" status: 200 len: 146 microversion: 2.1 time: 0.050265 Jun 15 22:17:45.689465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 180/344] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:17:45 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:45.873579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-96629a75-2f45-4cf9-b3cf-0bbbc33f9207 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370275 Jun 15 22:17:45.874586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 165/345] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:17:45 2022] POST /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:45.886873 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:45.887608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:45.894760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.895197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:45.896416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:45.897045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:46.089402 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:46.101060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3cd37d69-2989-47ab-b67f-03080a6c3c66 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.221125 Jun 15 22:17:46.102127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 181/346] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:45 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:46.438131 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:46.438950 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:46.453422 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:46.454191 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:46.455763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:46.456723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:46.497255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:46.498225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:46.505520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:46.506341 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:46.507648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:46.508347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:46.783474 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:46.786156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:46.796709 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2359a70f-2808-4353-b758-b645fb8c9c94 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.304269 Jun 15 22:17:46.798954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 182/347] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:46 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:46.813074 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d943047d-82fc-4bff-8f69-14cd08aef880 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1506 microversion: 2.1 time: 0.368131 Jun 15 22:17:46.815085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 166/348] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:46 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:47.128973 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:47.130218 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:47.142688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:47.143476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:47.146188 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:47.147317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:47.426631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:47.440177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-980667ca-02d0-4def-98b2-c59362bed8a0 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.324057 Jun 15 22:17:47.441566 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 183/349] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:47 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:47.819665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:47.820781 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:47.833377 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:47.834135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:47.835476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:47.836223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:48.100603 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:48.110511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b92c03d8-ab18-478e-baa6-94d537714566 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.298455 Jun 15 22:17:48.121971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 167/350] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:47 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:48.140020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-04c8359d-b9ee-4f00-b2d6-034be4958efa req-f9f7ac12-4482-4ae9-b278-72c49fa545bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464578c6-8b47-4ca7-b0cb-1d64f8e495d6", "name": "network-vif-plugged", "status": "completed", "tag": "ef115d0d-bf82-4a35-b1b6-04655b8479de"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:48.151164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-04c8359d-b9ee-4f00-b2d6-034be4958efa req-f9f7ac12-4482-4ae9-b278-72c49fa545bc service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:48.152191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-04c8359d-b9ee-4f00-b2d6-034be4958efa req-f9f7ac12-4482-4ae9-b278-72c49fa545bc service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:48.168318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-04c8359d-b9ee-4f00-b2d6-034be4958efa req-f9f7ac12-4482-4ae9-b278-72c49fa545bc service nova] Creating event network-vif-plugged:ef115d0d-bf82-4a35-b1b6-04655b8479de for instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 on hv-cinder-83538 Jun 15 22:17:48.175763 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-04c8359d-b9ee-4f00-b2d6-034be4958efa req-f9f7ac12-4482-4ae9-b278-72c49fa545bc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044420 Jun 15 22:17:48.177760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 184/351] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:17:48.467292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:48.468045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:48.476000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:48.476852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:48.477816 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:48.478333 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:48.663330 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d72742b-4834-453f-b4fd-92f945c4ba44"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:48.665873 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:48.674064 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:48.685257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:48.686449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:48.688118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:48.689145 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:48.746909 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:48.757299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b2981371-c878-4141-9561-57aa8aaa187d tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.295042 Jun 15 22:17:48.757980 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 168/352] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:48 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:49.128536 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:49.129597 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:49.136510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:49.137639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:49.137832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:49.138304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:49.345617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:49.367016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-31c97f10-d639-49b6-8b17-f497708da660 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.241906 Jun 15 22:17:49.367985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 169/353] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:49 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:49.708152 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ed62fb03-7ea9-49a6-a27d-611ba7684565 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.062387 Jun 15 22:17:49.709304 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 185/354] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:17:48 2022] POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-volume_attachments => generated 194 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:17:49.785659 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:49.795849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:49.818653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:49.818653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:49.818653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:49.818653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:50.057083 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:50.073570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5cc9741a-450b-430a-bdf3-8c83d5f0a9ce tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1313 microversion: 2.1 time: 0.300419 Jun 15 22:17:50.075994 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 170/355] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:49 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:50.388747 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:50.390174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:50.397402 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:50.397846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:50.398663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:50.399105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:50.603602 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:50.613303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f1250d6c-502a-4aef-823a-ee383d886192 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.230276 Jun 15 22:17:50.614239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 186/356] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:50 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:51.103062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:51.104259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:51.112890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:51.113368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:51.114317 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:51.114756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:51.296085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:51.304454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5976ea00-eb1a-48bd-8d59-f925d8a2bd9c tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1497 microversion: 2.1 time: 0.207970 Jun 15 22:17:51.305091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 171/357] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:51 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:51.644116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:51.644770 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:51.652100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:51.652771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:51.653647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:51.654087 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:51.800631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:51.817958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f437a241-4408-40c0-854c-375522bdd498 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.178652 Jun 15 22:17:51.818559 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 187/358] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:51 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:52.198441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:52.199094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:52.206517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:52.206952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:52.207730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:52.208154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:52.239722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:17:52.335019 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0b665922-48c7-45b1-9fe6-c43c968071d2 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "DELETE /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 204 len: 0 microversion: 2.1 time: 0.140533 Jun 15 22:17:52.335873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 172/359] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:17:52 2022] DELETE /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 22:17:52.347383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:52.348009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:52.355688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:52.356136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:52.356972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:52.357444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:52.528466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:52.544629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-69027a85-7e93-4d8f-add9-640624c39444 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1503 microversion: 2.1 time: 0.199208 Jun 15 22:17:52.544629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 188/360] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:52 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:52.840750 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:52.842062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:52.852602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:52.853457 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:52.854831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:52.855798 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:53.094977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:53.103759 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9abc3483-8dcb-4d17-a2f9-46256e398b64 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.271226 Jun 15 22:17:53.104654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 173/361] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:52 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:53.565456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:53.566367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:53.576559 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:53.576985 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:53.577823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:53.578243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:53.747837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:53.755979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-99d10122-7f2b-4968-bddb-00310b626e43 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1503 microversion: 2.1 time: 0.198885 Jun 15 22:17:53.756565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 189/362] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:53 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:54.158754 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:54.159835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:54.167989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:54.168441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:54.169307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:54.169808 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:54.353602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:54.366242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0e8e6e18-1199-4cbc-b535-2287f9f95101 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.220340 Jun 15 22:17:54.366996 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 174/363] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:54 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:54.787768 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:54.789688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:54.798310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:54.798854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:54.799887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:54.800939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:54.981287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:54.991019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dddde507-0cc3-4a24-a001-b21e6002ac4f tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1503 microversion: 2.1 time: 0.211871 Jun 15 22:17:54.991925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 190/364] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:54 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:55.387716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:55.388454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:55.396267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:55.396715 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:55.397551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:55.397997 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:55.402956 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:55.634773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:55.644583 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-547d08e8-c584-45b8-9df1-8f5a1000f237 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.264022 Jun 15 22:17:55.645179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 175/365] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:55 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:17:55.808260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-0f28394a-322a-4714-827d-3428fa364d3c req-bc92ade9-567e-4e40-ab53-a0e37aa02004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464578c6-8b47-4ca7-b0cb-1d64f8e495d6", "name": "network-vif-deleted", "tag": "ef115d0d-bf82-4a35-b1b6-04655b8479de"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:55.823753 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-0f28394a-322a-4714-827d-3428fa364d3c req-bc92ade9-567e-4e40-ab53-a0e37aa02004 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:55.824765 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-0f28394a-322a-4714-827d-3428fa364d3c req-bc92ade9-567e-4e40-ab53-a0e37aa02004 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:55.838293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-0f28394a-322a-4714-827d-3428fa364d3c req-bc92ade9-567e-4e40-ab53-a0e37aa02004 service nova] Creating event network-vif-deleted:ef115d0d-bf82-4a35-b1b6-04655b8479de for instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 on hv-cinder-83538 Jun 15 22:17:55.843986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-0f28394a-322a-4714-827d-3428fa364d3c req-bc92ade9-567e-4e40-ab53-a0e37aa02004 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042943 Jun 15 22:17:55.844606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 191/366] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:17:56.011209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:56.013466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:56.021781 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:56.022300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:56.023101 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:56.023623 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:56.061895 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:56.062346 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:56.062810 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lazy-loading 'fault' on Instance uuid 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:17:56.115635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3955b4cf3ef54207b09d7008906221e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635efdd4ea406eabfb397bdfd83d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:56.129020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-38503816-47dd-41e9-97f6-11b396068893 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 200 len: 1303 microversion: 2.1 time: 0.123621 Jun 15 22:17:56.129993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 176/367] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:56 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:56.534278 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-88802848-3235-4904-8a36-97d0c05804e8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: .version_select at 0x7f99db451160>, body: {"keypair": {"name": "tempest-keypair-283658027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIwNDpWtN5az0tnZVNQN/gIMdu0uyDknBvTaDKGhr3yUTpA41nkvwXXWCtcuCVDBZ7CG+P0gAE6DNRd1uLWL8ni7bXTOGfP81ijTqrso3QkW+MD0YwKhkgGDuknMHeTwA=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:56.552509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-88802848-3235-4904-8a36-97d0c05804e8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:56.557186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-88802848-3235-4904-8a36-97d0c05804e8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:56.586668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-88802848-3235-4904-8a36-97d0c05804e8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057381 Jun 15 22:17:56.590184 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 192/368] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:17:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:17:56.673464 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:56.674350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:56.684542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:56.685662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:56.687046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:56.687899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:56.851960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:56.864079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-242da5c9-bef1-48e6-b269-74bee18188ae tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.195906 Jun 15 22:17:56.864862 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 177/369] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:56 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:57.153438 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:57.154190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] [instance: 464578c6-8b47-4ca7-b0cb-1d64f8e495d6] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:57.161657 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:57.162150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:57.162953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:57.163396 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:57.190829 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] HTTP exception thrown: Instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 could not be found. Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Request method failure captured: Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 HTTP/1.1 Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlph0UGA2NAKFdvSpGve5Gpf4ehi0IzrlhR9lk7bt7xyiK8u52nJ9Cjz78DDDEJrE4R4aL7Y2eMOA3nHgtUqcMXOZO7sCq4ZGcmMMtPOV05D7ntQYWq2OiMoXc_LKjKa-MSbKzVP6PbgvzmcnQ_3AixvSuzD5e3gw0Jfxd6ofLS1BPk Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: f8635efdd4ea406eabfb397bdfd83d07 Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesActionsTest-1318816648 Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:17:57.194151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f8635efdd4ea406eabfb397bdfd83d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f8635efdd4ea406eabfb397bdfd83d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f8635efdd4ea406eabfb397bdfd83d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f8635efdd4ea406eabfb397bdfd83d07", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesActionsTest-1318816648 Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: f8635efdd4ea406eabfb397bdfd83d07 Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesActionsTest-1318816648 Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesActionsTest-1318816648-project Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 3955b4cf3ef54207b09d7008906221e7 Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesActionsTest-1318816648-project Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 could not be found. Jun 15 22:17:57.195557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '464578c6-8b47-4ca7-b0cb-1d64f8e495d6'} Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 could not be found. Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:17:57.196430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 could not be found. Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 could not be found. Jun 15 22:17:57.197776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:17:57.199119 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] Returning 404 to user: Instance 464578c6-8b47-4ca7-b0cb-1d64f8e495d6 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:17:57.199119 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-96ab9f14-914c-4965-8dd5-5328f07deb38 tempest-VolumesActionsTest-1318816648 tempest-VolumesActionsTest-1318816648-project] 10.222.0.55 "GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6" status: 404 len: 111 microversion: 2.1 time: 0.047864 Jun 15 22:17:57.199119 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 193/370] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:57 2022] GET /compute/v2.1/servers/464578c6-8b47-4ca7-b0cb-1d64f8e495d6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:57.886867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:57.890881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:57.915301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:57.916640 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:57.917528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:57.918471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:58.394215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:58.403704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-81e43e22-82d1-44e6-a2ea-a5b502bcabd0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.523536 Jun 15 22:17:58.404268 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 178/371] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:57 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:58.628186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-909885867", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51970d37-d292-4c3d-bdb6-727ed5d05edc"}], "security_groups": [{"name": "tempest-securitygroup--1709222283"}], "key_name": "tempest-keypair-283658027", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:17:58.777546 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] validate_networks() for [('51970d37-d292-4c3d-bdb6-727ed5d05edc', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:17:59.325867 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:17:59.326641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:17:59.329185 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:17:59.330031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:17:59.330821 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:17:59.347076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:59.347530 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:59.348680 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:59.349855 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:59.371453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:17:59.376951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:17:59.391978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:17:59.393606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:17:59.421973 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:59.422578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:59.432647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:59.433292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:59.434714 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:17:59.435233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:17:59.481633 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7b9e74b1-6c7f-44a7-8d58-f40dab56c494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.860149 Jun 15 22:17:59.483377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 194/372] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:17:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:17:59.493461 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c8248d00-a855-4487-ba62-f6a3f6923289 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:17:59.494091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c8248d00-a855-4487-ba62-f6a3f6923289 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:17:59.579878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c8248d00-a855-4487-ba62-f6a3f6923289 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:59.598333 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c8248d00-a855-4487-ba62-f6a3f6923289 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1240 microversion: 2.1 time: 0.108783 Jun 15 22:17:59.608956 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 195/373] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:59 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:17:59.709131 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:17:59.720394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-93317f55-0c2e-4cf2-b2f2-17a20c6217f9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.302907 Jun 15 22:17:59.721297 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 179/374] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:17:59 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:00.620003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:00.620003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:00.625142 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:00.625620 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:00.626353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:00.626778 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:00.700410 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:00.713156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3a434878-7097-4104-8fda-4b7576fddcff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1244 microversion: 2.1 time: 0.100300 Jun 15 22:18:00.713908 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 196/375] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:00 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:00.739649 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:00.740374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:00.748156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:00.748592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:00.749421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:00.749859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:00.940524 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:00.949561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5e0e8959-01e4-4fb8-8492-4e72aa837daa tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.214058 Jun 15 22:18:00.950310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 180/376] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:00 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:01.730888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:01.731746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:01.738924 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:01.739462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:01.740335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:01.740973 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:01.829736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:01.839718 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3d41a0f6-5933-45da-8a93-e8de694d605d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1236 microversion: 2.1 time: 0.112592 Jun 15 22:18:01.840665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 197/377] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:01 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:01.972203 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:01.972939 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:01.980521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:01.980521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:01.981562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:01.982185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:02.153015 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:02.165994 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5d1bb889-bb95-4257-b652-66383220833a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.197529 Jun 15 22:18:02.166590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 181/378] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:01 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:02.863376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:02.864589 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:02.875757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:02.877097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:02.877961 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:02.878483 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:02.951716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:02.960143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-28aac755-a4de-4cc4-be2b-e78e89bf03b2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1292 microversion: 2.1 time: 0.104312 Jun 15 22:18:02.960582 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 198/379] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:02 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:03.185354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:03.186058 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:03.195984 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:03.196910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:03.198118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:03.198631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:03.375994 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:03.389107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fbbbd9ed-9762-468a-9898-4aa3d0060d35 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.208054 Jun 15 22:18:03.390436 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 182/380] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:03 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:03.979562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:03.982138 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:03.993052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:03.993937 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:03.995528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:03.996298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:04.029944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:04.088205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:04.104890 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-62d0f3b2-8d49-4e6c-a56a-9fe2f43a0aca tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1292 microversion: 2.1 time: 0.130152 Jun 15 22:18:04.106367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 199/381] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:03 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:04.410601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:04.412821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:04.425096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:04.425791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:04.427068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:04.427729 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:04.676455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:04.685344 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-995001c4-f327-4b78-afeb-d5b508348485 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.282006 Jun 15 22:18:04.686386 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 183/382] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:04 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:05.131592 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:05.132982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:05.140891 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:05.140891 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:05.141662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:05.142154 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:05.233736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:05.248554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bfe1e819-cac1-4f88-abfd-571367c6300a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1292 microversion: 2.1 time: 0.121185 Jun 15 22:18:05.263093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 200/383] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:05 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1292 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:05.705932 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:05.707435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:05.715696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:05.716555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:05.717738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:05.718434 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:05.956472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:05.971873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-53f00e92-4a6c-4d0d-ad3f-6d1ebfbe11ac tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.270923 Jun 15 22:18:05.972955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 184/384] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:05 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:06.281925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:06.282587 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:06.289580 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:06.289986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:06.291577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:06.291577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:06.366644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:06.384657 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bdf5ebd4-b63e-48a6-a427-2b0517d7d59f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1292 microversion: 2.1 time: 0.116047 Jun 15 22:18:06.386442 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 201/385] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:06 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:06.994849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:06.998520 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:07.011891 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:07.013446 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:07.015372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:07.016199 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:07.267592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:07.278957 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-944da000-bc74-45b8-9266-59216704c947 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.291524 Jun 15 22:18:07.281960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 185/386] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:06 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:07.404345 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:07.405074 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:07.413200 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:07.414151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:07.415178 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:07.416033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:07.497185 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:07.506992 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-25d006c3-10b2-4b40-90a4-e9729b1e5b16 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1292 microversion: 2.1 time: 0.106657 Jun 15 22:18:07.507772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 202/387] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:07 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1292 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:08.310370 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:08.312035 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:08.334595 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.335424 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.336782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.337639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.426670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d8d265f1-eeb2-4cd2-919c-1a4822184913 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:08.440823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d8d265f1-eeb2-4cd2-919c-1a4822184913 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.441726 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d8d265f1-eeb2-4cd2-919c-1a4822184913 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.514882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d8d265f1-eeb2-4cd2-919c-1a4822184913 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Going to try to stop instance {{(pid=117629) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 22:18:08.599070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d8d265f1-eeb2-4cd2-919c-1a4822184913 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action" status: 202 len: 0 microversion: 2.1 time: 0.177849 Jun 15 22:18:08.600016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 203/388] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:18:08 2022] POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:18:08.605810 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:08.607876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:08.616346 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.617838 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.619045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.619661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.706942 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:08.716086 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-079b7b60-9382-42ac-9534-56516d6d0147 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1298 microversion: 2.1 time: 0.114401 Jun 15 22:18:08.716932 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 204/389] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:08 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:08.725625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:08.735879 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:08.736897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-48759809-a589-4134-9674-1d7dde5bd424 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.433648 Jun 15 22:18:08.737755 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:08.740692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 186/390] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:08 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:08.747154 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.748050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.749179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:08.749973 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:08.917307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:08.931636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aa707791-135a-4597-9461-abc2e08f5b58 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.213269 Jun 15 22:18:08.932456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 205/391] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:08 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:09.739104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:09.741908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:09.768238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:09.774735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:09.782064 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:09.786394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:09.794882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:09.798541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:09.834273 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:09.843561 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=12 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:09.862889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:09.864117 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:09.867954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:09.868740 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.056587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:10.087916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5f367b81-630a-4048-b4c5-20af7d5db695 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.357578 Jun 15 22:18:10.088951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 187/392] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:09 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:10.096735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:10.098331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:10.106763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.107342 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.108197 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.108703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.122480 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:10.130087 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78076ff9-1a7a-4e1d-a80d-60c46581767b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1501 microversion: 2.1 time: 0.370888 Jun 15 22:18:10.131289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 206/393] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:09 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1501 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:10.149240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bc03842-61b5-4e2f-9514-e1373709a71a"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:10.150433 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:10.165236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.165763 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.166555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.166984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.203389 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] HTTP exception thrown: Cannot 'attach_volume' instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 while it is in vm_state rescued Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Request method failure captured: Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/os-volume_attachments HTTP/1.1 Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 74 Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloXw0IITTlRon91G0EAcwBI5qlMcZN5dlWyaYwqJtzGgHBdrhPz3qqV_liwCSOHZLd9uE7nkL7IsTKKAH8sw92b-z7g3YwxQZkRprUFDUrhO0BHGJJg2oDbwR_bPGADhWizwNu-Rl-ymPAWSQlwe0-TJ5UGv0u1fRo4Gk-4AozYWBs Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:18:10.205210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0713040636b4408c95dcadbb9b1fe3cc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 9be9445fdbc4459da4feb7c0bc1b310f Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {"volumeAttachment": {"volumeId": "3bc03842-61b5-4e2f-9514-e1373709a71a"}} Jun 15 22:18:10.206573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Cannot 'attach_volume' instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 while it is in vm_state rescued Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'server_id': 'eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8', 'body': {'volumeAttachment': {'volumeId': '3bc03842-61b5-4e2f-9514-e1373709a71a'}}} Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:18:10.207334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 while it is in vm_state rescued Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:18:10.208875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 while it is in vm_state rescued Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Returning 409 to user: Cannot 'attach_volume' instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 while it is in vm_state rescued {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5a5348f8-0d22-49bf-8a83-757afa0a8bff tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062083 Jun 15 22:18:10.210016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 207/394] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:18:10 2022] POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 22:18:10.216461 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:10.216990 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:10.229798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.230157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.230996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.231401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.278417 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:10.290973 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f52c407f-5ccf-4071-943d-a0bc4856638a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.200563 Jun 15 22:18:10.292254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 188/395] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:10 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:10.339098 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-61c39ca8-06f1-41ee-82c8-aefed01b63d2 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/action" status: 202 len: 0 microversion: 2.1 time: 0.126351 Jun 15 22:18:10.340193 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 208/396] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:18:10 2022] POST /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 22:18:10.349439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:10.349795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:10.357758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.358614 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.359723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.360419 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.537514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:10.541218 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3578dfe7-0447-4154-b704-0d060e880762", "device": "/dev/sdb"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:10.543044 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:10.546540 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a1b14744-2735-481d-8b83-e9301d35aa4f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1509 microversion: 2.1 time: 0.201619 Jun 15 22:18:10.547128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 189/397] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:10 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:10.550244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.550715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:10.551564 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:10.551993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.107752 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:11.108971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:11.120968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:11.121454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.127411 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:11.128135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.170115 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-916d09b5-77af-4abb-93d2-7a68a89babb1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "POST /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633414 Jun 15 22:18:11.171674 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 209/398] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:18:10 2022] POST /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:18:11.329240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:11.331060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:11.370328 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:11.370837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.372250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:11.372250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.525768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:11.539062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bf90f3b5-fec8-48cd-948d-4c7fa3124730 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.436207 Jun 15 22:18:11.539652 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 190/399] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:11 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:11.572881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:11.574968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:11.588410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:11.589284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.590497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:11.590634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:11.591960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:11.604446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-41d10d0f-6885-4cc3-80eb-d8b7277b1ce4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.293268 Jun 15 22:18:11.609720 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 210/400] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:11 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:11.625199 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:12.015407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:12.045122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-26e14ca8-bf8e-4f2a-a56a-8f37b6b30c08 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1509 microversion: 2.1 time: 0.483164 Jun 15 22:18:12.055996 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 191/401] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:11 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1509 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:12.487025 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-3e999cbd-8a22-47c1-9485-6f781bf229af req-f0e18339-7597-4f4f-9c53-cc0cc3f9523a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32272089-e3c2-4bf4-b24f-afd378c89989", "tag": "989aa53e-9f3f-433e-ae52-6b4be9f96a94"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:12.499228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3e999cbd-8a22-47c1-9485-6f781bf229af req-f0e18339-7597-4f4f-9c53-cc0cc3f9523a service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:12.499596 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3e999cbd-8a22-47c1-9485-6f781bf229af req-f0e18339-7597-4f4f-9c53-cc0cc3f9523a service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:12.555021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-3e999cbd-8a22-47c1-9485-6f781bf229af req-f0e18339-7597-4f4f-9c53-cc0cc3f9523a service nova] Creating event network-changed:989aa53e-9f3f-433e-ae52-6b4be9f96a94 for instance 32272089-e3c2-4bf4-b24f-afd378c89989 on hv-cinder-83538 Jun 15 22:18:12.557485 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:12.558410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:12.571441 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-3e999cbd-8a22-47c1-9485-6f781bf229af req-f0e18339-7597-4f4f-9c53-cc0cc3f9523a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088576 Jun 15 22:18:12.571674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:12.572160 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 211/402] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:12.575562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:12.579213 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:12.579988 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:12.632686 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:12.633452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:12.644186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:12.644780 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:12.649208 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:12.650315 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:12.872048 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:12.894091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9bfadb7f-e5de-4b0d-bf2f-d45da9d7f494 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.340222 Jun 15 22:18:12.905673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 192/403] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:12 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:12.938851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:12.951179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b6c76890-bff3-4925-b15c-be46e51ddac4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.329506 Jun 15 22:18:12.953721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 212/404] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:12 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:13.072757 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:13.073906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:13.076078 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:13.083837 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:13.084636 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:13.085723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:13.086324 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:13.252491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:13.260831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b1029a6f-7e6a-4f50-8dcc-7f98ae87cebd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1509 microversion: 2.1 time: 0.192449 Jun 15 22:18:13.271079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 193/405] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:13 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:13.913650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:13.914412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:13.921109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:13.921583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:13.922337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:13.923116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:13.971643 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:13.973050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:13.981628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:13.982517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:13.983476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:13.983916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:14.109462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:14.113340 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:14.126275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7846f4a9-9459-484b-9937-30d54c07cb0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.216937 Jun 15 22:18:14.127313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 213/406] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:13 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:14.178747 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:14.188666 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8513c303-d430-471d-bf87-d17fbf3d5da2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.221504 Jun 15 22:18:14.189501 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 194/407] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:13 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:14.277671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:14.278747 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:14.286574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:14.287292 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:14.288275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:14.288862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:14.440565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:14.453364 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-695a65c2-44b8-4be9-81f4-5afe92b33fd1 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1509 microversion: 2.1 time: 0.179017 Jun 15 22:18:14.459264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 214/408] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:14 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:15.144149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:15.145010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:15.152001 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:15.152566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:15.153716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:15.154508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:15.207881 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:15.209688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:15.230768 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:15.231636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:15.232939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:15.233593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:15.349679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:15.360107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e0593889-c803-4485-8aa9-0ea572b6b875 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.219695 Jun 15 22:18:15.362642 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 195/409] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:15 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:15.401369 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:15.413616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-98283f5b-8e8b-40b6-8afc-7e13d257ef54 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.210310 Jun 15 22:18:15.425183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 215/410] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:15 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:15.473302 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:15.474008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:15.481054 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:15.481703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:15.482502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:15.482946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:15.698134 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:15.707099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fd1d4962-a50d-4105-8f44-5fb6c87fa1f6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1515 microversion: 2.1 time: 0.239102 Jun 15 22:18:15.710105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 196/411] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:15 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:16.380063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:16.381488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:16.392270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:16.392864 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:16.393636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:16.394069 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:16.432307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:16.433098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:16.442851 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:16.443307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:16.444100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:16.444533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:16.550183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:16.562466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e77b8da1-bf60-4de7-b419-99c76c216df6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.186358 Jun 15 22:18:16.563361 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 216/412] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:16 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:16.622296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:16.631485 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c8268385-10d6-4497-9423-6fb54fa5cbd8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.203214 Jun 15 22:18:16.632084 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 197/413] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:16 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:17.229040 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3ebb33f7-a6b3-421e-85ad-b25ae4a96de5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'create', calling method: .version_select at 0x7f99db6cea60>, body: {"keypair": {"name": "tempest-keypair-1409085370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECMGgePcdCE44PCFrrRcEcYyp+hYnc5D6U4JWLph2YQl4tNd8Pl9fV0bJqcp8LNQT3SlCXKROg9aGAk4Z6yi/XoVtcHffXgBhG4qbv9i/uMSIKFSh9msVvDcIV+zLXE7g=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:17.245758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-3ebb33f7-a6b3-421e-85ad-b25ae4a96de5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:18:17.251010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-3ebb33f7-a6b3-421e-85ad-b25ae4a96de5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for user 9be9445fdbc4459da4feb7c0bc1b310f and project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:18:17.264198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:17.286232 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3ebb33f7-a6b3-421e-85ad-b25ae4a96de5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061077 Jun 15 22:18:17.287513 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 217/414] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:18:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:17.593972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:17.603622 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:17.622380 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:17.624349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:17.627447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:17.628717 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:17.659527 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:17.660805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:17.677982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:17.678428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:17.683575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:17.684349 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:17.831314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:17.846502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-af75b297-ecd3-4f77-a029-0e438ec19d93 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.268908 Jun 15 22:18:17.861385 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 198/415] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:17 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:17.933228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:17.949277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-56a24266-9604-4406-b202-0f76a19c1095 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.295285 Jun 15 22:18:17.950353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 218/416] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:17 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:18.867037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:18.867657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:18.875933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:18.876847 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:18.877825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:18.879439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:18.968628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:18.969365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:18.975630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:18.976081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:18.976847 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:18.980992 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:19.058415 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:19.068211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5baad45d-114f-40fe-956c-361c759eaab7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.204520 Jun 15 22:18:19.068799 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 199/417] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:18 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:19.304481 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:19.324282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ccd058cd-a2f1-4800-a094-76184d8d7342 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.355635 Jun 15 22:18:19.324282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 219/418] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:18 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:19.451085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1115580861", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "940602c4-8f41-4c18-9ab7-0dca7ab44fe8"}], "security_groups": [{"name": "tempest-securitygroup--763999749"}], "key_name": "tempest-keypair-1409085370", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:19.575799 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] validate_networks() for [('940602c4-8f41-4c18-9ab7-0dca7ab44fe8', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:18:20.088630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:20.090886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:20.101940 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:20.102809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:20.103636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:20.104541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:20.226316 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:18:20.228452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:18:20.229693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:18:20.230427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:18:20.231157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:18:20.271107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:20.274916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:20.276306 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:20.284057 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:20.324065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:18:20.347604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:20.350661 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Getting quotas for user 9be9445fdbc4459da4feb7c0bc1b310f and project 0713040636b4408c95dcadbb9b1fe3cc. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:18:20.357048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7b2100b5-5dbd-4d8f-81eb-09b566c665bc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.274161 Jun 15 22:18:20.358008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 220/419] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:20 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:20.374524 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:18:20.376236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:20.378923 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:20.379371 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:18:20.386766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:20.387593 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:20.392806 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:20.393861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:20.483312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-12793dd2-67ae-4055-a425-1acf64149b2d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.037765 Jun 15 22:18:20.488799 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 200/420] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:18:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:18:20.506590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-994cfa58-3a6e-436a-a720-f960f42c3767 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:20.507742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-994cfa58-3a6e-436a-a720-f960f42c3767 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:20.644027 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-994cfa58-3a6e-436a-a720-f960f42c3767 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:20.657732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-994cfa58-3a6e-436a-a720-f960f42c3767 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1246 microversion: 2.1 time: 0.158493 Jun 15 22:18:20.658601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 201/421] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:20 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:20.711545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:20.747186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-03599950-dc56-4c3b-accf-e8305a04b671 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.374459 Jun 15 22:18:20.748982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 221/422] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:20 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:21.375730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:21.377133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:21.401929 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:21.402370 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:21.406940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:21.407619 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:21.682581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:21.683361 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:21.705542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:21.709277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:21.710254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:21.710644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:21.800455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:21.816694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2fb91ac6-949f-4213-b0d0-71d780f67f7d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1242 microversion: 2.1 time: 0.138670 Jun 15 22:18:21.816694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 222/423] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:21 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:21.823679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:21.823679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:21.850895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:21.851349 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:21.852600 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:21.853196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:21.912356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:21.933517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6d60e02b-1378-41b7-8682-daa823451561 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.562028 Jun 15 22:18:21.936338 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 202/424] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:21 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:22.110373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:22.131188 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b574b177-1e12-4341-91d6-f42653dbbd59 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.316249 Jun 15 22:18:22.133441 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 223/425] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:21 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:22.842887 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:22.843536 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:22.854030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:22.854492 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:22.855289 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:22.855722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:22.944927 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:22.956686 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fb163303-c46d-4f97-90db-34cee02ec68d tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1298 microversion: 2.1 time: 0.117732 Jun 15 22:18:22.957665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 203/426] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:22 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:22.957869 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:22.958692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:22.965951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:22.966394 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:22.968052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:22.968052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:23.143092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:23.153163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9aae79ee-424d-439b-813e-9d1c2e9056b1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.199073 Jun 15 22:18:23.154118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 224/427] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:22 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:23.155385 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:23.156624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:23.167353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:23.168098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:23.169624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:23.170324 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:23.342474 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:23.357660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6901aae4-875a-4110-b9b0-a5687065e4d8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.208799 Jun 15 22:18:23.358678 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 204/428] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:23 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:23.984979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:23.985730 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:23.993070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:23.993569 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:23.994357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:23.994798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:24.066423 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:24.076954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8ba9a444-bfa0-4358-8229-22d5fa33976e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1298 microversion: 2.1 time: 0.095929 Jun 15 22:18:24.077620 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 225/429] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:23 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:24.176514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:24.177310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:24.184937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:24.185394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:24.186213 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:24.186612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:24.360077 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:24.370188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d02d3704-7759-40bd-9b20-4219f1be4427 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.197502 Jun 15 22:18:24.370929 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 205/430] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:24 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:24.385951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:24.386685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:24.393799 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:24.394236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:24.395012 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:24.395438 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:24.552524 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:24.561797 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-39f98f6d-ff52-432c-bd70-cb28f551a2d1 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.182583 Jun 15 22:18:24.562378 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 226/431] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:24 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:25.104199 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:25.105115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:25.115718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:25.116637 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:25.118768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:25.122241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:25.218922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:25.233596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5508e3f3-5c22-467b-94e1-ad0cde4caac9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1306 microversion: 2.1 time: 0.136208 Jun 15 22:18:25.234919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 206/432] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:25 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:25.396678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:25.398516 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:25.406951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:25.407402 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:25.408190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:25.408618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:25.584438 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:25.585345 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:25.586460 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:25.592498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:25.592937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:25.593782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:25.594238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:25.596868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-00e2ffb1-43e9-4208-b0d3-698c3780c439 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.206957 Jun 15 22:18:25.598007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 227/433] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:25 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:25.757910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:25.767833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8ab2836d-c87a-4e71-8e53-258340469f8b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.188793 Jun 15 22:18:25.776035 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 207/434] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:25 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:26.252548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:26.253379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:26.262984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:26.263954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:26.265684 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:26.266224 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:26.363375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:26.375154 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-040176af-4e72-46e8-a54b-1b887c77e159 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1304 microversion: 2.1 time: 0.127150 Jun 15 22:18:26.385305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 228/435] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:26 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:26.623479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:26.624294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:26.634089 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:26.635134 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:26.636592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:26.637482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:26.787576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:26.788276 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:26.801892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:26.801892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:26.802393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:26.803181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:27.012997 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:27.023671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ac035e24-be72-4fd7-819d-c61955628092 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.409234 Jun 15 22:18:27.030289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:27.036397 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 208/436] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:26 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:27.042967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0c15a6c5-558b-4d76-8fa1-c1a7080ad463 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.259204 Jun 15 22:18:27.044377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 229/437] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:26 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:27.395628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:27.396181 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:27.402768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:27.403218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:27.404001 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:27.404425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:27.553300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:27.557315 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:27.563859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-72da329e-3beb-4e27-84aa-4697d6af0d67 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.173198 Jun 15 22:18:27.564802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 209/438] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:27 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:28.061600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:28.062262 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:28.062667 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:28.062764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:28.064616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=4 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:28.069637 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:28.070094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:28.070883 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:28.071211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:28.071341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:28.071663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:28.072478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:28.072934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:28.211901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:28.220651 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1db21579-48d1-4407-a97a-f384d15bb131 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.170574 Jun 15 22:18:28.226658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 230/439] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:28 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:28.226769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:28.233222 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6db4a548-31f8-4dcb-b0ca-8b33497ecd3e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.175705 Jun 15 22:18:28.237502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 210/440] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:28 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:28.582521 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:28.583126 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:28.589509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:28.589963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:28.591454 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:28.592270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:28.615102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:28.739899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:28.748883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-91475fcb-30ee-456f-98e3-2416c30892d4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.170244 Jun 15 22:18:28.749480 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 231/441] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:28 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:29.246822 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:29.248280 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:29.251069 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:29.252263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:29.258314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.259021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:29.259279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.259898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:29.260350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.260675 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.261110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:29.261296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:29.443578 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:29.457077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b13478ae-8a91-458f-9f9f-244c9ee738cd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.210393 Jun 15 22:18:29.457979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 232/442] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:29 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:29.511271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:29.519477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-c775ac0a-2889-4433-b787-14b59dcbf044 req-47ac863e-dc77-4de5-98a7-eb742ddfa748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32272089-e3c2-4bf4-b24f-afd378c89989", "name": "network-vif-plugged", "status": "completed", "tag": "989aa53e-9f3f-433e-ae52-6b4be9f96a94"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:29.524881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fe48ca7a-fa07-48ac-90a8-e5894ca4a234 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.283036 Jun 15 22:18:29.527169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 211/443] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:29 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:29.535892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c775ac0a-2889-4433-b787-14b59dcbf044 req-47ac863e-dc77-4de5-98a7-eb742ddfa748 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.536345 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c775ac0a-2889-4433-b787-14b59dcbf044 req-47ac863e-dc77-4de5-98a7-eb742ddfa748 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:29.551320 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-c775ac0a-2889-4433-b787-14b59dcbf044 req-47ac863e-dc77-4de5-98a7-eb742ddfa748 service nova] Creating event network-vif-plugged:989aa53e-9f3f-433e-ae52-6b4be9f96a94 for instance 32272089-e3c2-4bf4-b24f-afd378c89989 on hv-cinder-83538 Jun 15 22:18:29.558395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-c775ac0a-2889-4433-b787-14b59dcbf044 req-47ac863e-dc77-4de5-98a7-eb742ddfa748 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045802 Jun 15 22:18:29.559581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 233/444] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:29.767573 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:29.769182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:29.784791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.785299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:29.786589 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:29.787200 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:30.006713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:30.015977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6fffd17d-a902-4b68-8881-1c0a66eef852 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.253295 Jun 15 22:18:30.016681 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 212/445] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:29 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:30.072870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-76569252-c70b-49cd-a8b1-1f6635d1d6e8 req-f35fd7d6-b76f-46a4-a778-2a8c542db8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2cc42c-43f5-437a-89a9-94a1609e986f", "tag": "dfdc84d8-1923-419b-b5e6-bcaa18ced6d3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:30.082496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-76569252-c70b-49cd-a8b1-1f6635d1d6e8 req-f35fd7d6-b76f-46a4-a778-2a8c542db8e2 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:30.082928 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-76569252-c70b-49cd-a8b1-1f6635d1d6e8 req-f35fd7d6-b76f-46a4-a778-2a8c542db8e2 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:30.096588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-76569252-c70b-49cd-a8b1-1f6635d1d6e8 req-f35fd7d6-b76f-46a4-a778-2a8c542db8e2 service nova] Creating event network-changed:dfdc84d8-1923-419b-b5e6-bcaa18ced6d3 for instance 5e2cc42c-43f5-437a-89a9-94a1609e986f on hv-cinder-83538 Jun 15 22:18:30.102156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-76569252-c70b-49cd-a8b1-1f6635d1d6e8 req-f35fd7d6-b76f-46a4-a778-2a8c542db8e2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035123 Jun 15 22:18:30.103094 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 234/446] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:30.476710 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:30.477489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:30.481650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:30.486955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:30.487525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:30.488739 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:30.489406 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:30.546317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:30.547177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:30.554558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:30.555277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:30.556155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:30.556690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:30.648668 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:30.663625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:30.672959 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a2f5c75-7371-419a-9ce4-a391bbf85dc5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.200896 Jun 15 22:18:30.673875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 213/447] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:30 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:30.824118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:30.834050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c8570bc-feb8-48ca-b1ce-87b9cd077687 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.293570 Jun 15 22:18:30.834734 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 235/448] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:30 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:31.034743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:31.035452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:31.050283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:31.050734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:31.051541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:31.051974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:31.199251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:31.207468 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4facb8e1-9e58-4343-8ee5-53042faec576 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.177502 Jun 15 22:18:31.208017 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 214/449] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:31 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:31.692577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:31.693282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:31.699731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:31.700834 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:31.701713 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:31.702332 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:31.853519 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:31.854771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:31.863775 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:31.864247 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:31.865231 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:31.865694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:31.865882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:31.877577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1afbb1c8-2a31-4b3a-8d8d-11eaf6098c03 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.189507 Jun 15 22:18:31.878573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 236/450] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:31 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:32.227307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:32.230523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:32.237102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:32.237578 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:32.238544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:32.239148 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:32.279655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:32.294130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-93cca5d6-5894-4685-9220-026244e6c2e5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1366 microversion: 2.1 time: 0.445655 Jun 15 22:18:32.294736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 215/451] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:31 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:32.394648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:32.403468 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-29d9a0ae-a927-4b7c-bb29-ad3adf734785 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.179795 Jun 15 22:18:32.406504 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 237/452] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:32 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:32.900368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:32.902147 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:32.916250 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:32.917289 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:32.918763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:32.919477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.190101 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:33.201236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0d05bc40-eb7e-4ac2-bdf0-351379c8199d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.308107 Jun 15 22:18:33.210468 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 216/453] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:32 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:33.310547 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:33.311217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:33.318040 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.318497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.319311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.319754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.420975 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:33.421650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:33.428528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.428984 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.429791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.430224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.480000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:33.488968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b38dd616-2658-46d7-9a5c-3abd2caf5575 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1555 microversion: 2.1 time: 0.182420 Jun 15 22:18:33.489603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 238/454] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:33 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:33.509195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:33.509715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:33.519284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.519842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.520732 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.521186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.587565 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:33.595554 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6c8b52b4-f3b5-4735-87a7-57f416e5f2be tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.178673 Jun 15 22:18:33.596330 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 217/455] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:33 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:33.609815 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-77b76324-3fc6-4790-90e5-8feb8f8984d0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104505 Jun 15 22:18:33.610416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 239/456] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:18:33 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:18:33.651498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:33.652113 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:33.659099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.659546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.660319 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:33.660750 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:33.800772 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'services' on Instance uuid 37ced019-d078-4b0d-86c0-8fba6272c7b8 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:33.927060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-13e5745a-7868-427a-afa2-71037b986770 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "DELETE /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8/os-volume_attachments/3578dfe7-0447-4154-b704-0d060e880762" status: 202 len: 0 microversion: 2.1 time: 0.279509 Jun 15 22:18:33.927967 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 218/457] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:18:33 2022] DELETE /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8/os-volume_attachments/3578dfe7-0447-4154-b704-0d060e880762 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:18:34.219181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:34.219802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:34.226502 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:34.226958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:34.227743 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:34.228181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:34.518635 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:34.531146 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a6210350-61cb-40d9-b6c0-ec1e831b86a9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.315966 Jun 15 22:18:34.531806 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 240/458] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:34 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:34.613043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:34.614106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:34.622433 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:34.622976 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:34.623885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:34.624394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:34.799021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:34.810950 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5bd33051-f371-4cb0-a56a-88741393442e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.202115 Jun 15 22:18:34.811882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 219/459] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:34 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:35.022739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-6c4e794a-4f5f-4326-b42f-8a9dbbaae351 req-c46cf463-496a-4286-944a-928841b200aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32272089-e3c2-4bf4-b24f-afd378c89989", "tag": "989aa53e-9f3f-433e-ae52-6b4be9f96a94"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:35.031735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6c4e794a-4f5f-4326-b42f-8a9dbbaae351 req-c46cf463-496a-4286-944a-928841b200aa service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:35.032181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6c4e794a-4f5f-4326-b42f-8a9dbbaae351 req-c46cf463-496a-4286-944a-928841b200aa service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:35.050844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-6c4e794a-4f5f-4326-b42f-8a9dbbaae351 req-c46cf463-496a-4286-944a-928841b200aa service nova] Creating event network-changed:989aa53e-9f3f-433e-ae52-6b4be9f96a94 for instance 32272089-e3c2-4bf4-b24f-afd378c89989 on hv-cinder-83538 Jun 15 22:18:35.061801 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-6c4e794a-4f5f-4326-b42f-8a9dbbaae351 req-c46cf463-496a-4286-944a-928841b200aa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043499 Jun 15 22:18:35.062544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 241/460] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:35.550106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:35.550723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:35.557714 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:35.558571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:35.559748 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:35.560472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:35.805310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:35.822374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-76b828bc-901a-4ab9-a96d-9013b0e08399 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1724 microversion: 2.1 time: 0.277541 Jun 15 22:18:35.833598 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:35.834700 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 220/461] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:35 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:35.836130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:35.846348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:35.847020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:35.847851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:35.848288 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:36.027794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:36.047376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e16081bf-7423-40ce-950f-12451a6db525 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.221546 Jun 15 22:18:36.049153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 242/462] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:35 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:36.227930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:36.239461 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:36.260319 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:36.261643 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:36.263534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:36.264322 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:36.331001 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:18:36.503011 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-04ae2d62-d931-4692-a4b5-1310d26553b3 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "DELETE /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 204 len: 0 microversion: 2.1 time: 0.284427 Jun 15 22:18:36.506105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 221/463] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:18:36 2022] DELETE /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:18:36.518916 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:36.520232 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:36.529551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:36.530001 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:36.531755 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:36.532272 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:36.723850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:36.732551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8ab4f06e-18d1-4b56-9e0d-ef166a5738b7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1512 microversion: 2.1 time: 0.221488 Jun 15 22:18:36.733148 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 243/464] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:36 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:36.852889 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:36.855006 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:36.864999 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:36.865507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:36.866275 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:36.866709 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.032480 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:37.047019 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-162a7e8f-c7af-470b-941f-e5882ca8b1ea tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1701 microversion: 2.1 time: 0.198877 Jun 15 22:18:37.047624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 222/465] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:36 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1701 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:37.065178 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-22ce7e3d-ab0d-42b1-a0de-8e26b5a94e71 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:37.066081 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:37.066081 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:37.072746 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.073202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.073489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-22ce7e3d-ab0d-42b1-a0de-8e26b5a94e71 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.073939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-22ce7e3d-ab0d-42b1-a0de-8e26b5a94e71 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.074053 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.074516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.099463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-22ce7e3d-ab0d-42b1-a0de-8e26b5a94e71 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Going to try to start instance {{(pid=117629) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 22:18:37.153861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-22ce7e3d-ab0d-42b1-a0de-8e26b5a94e71 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action" status: 202 len: 0 microversion: 2.1 time: 0.093208 Jun 15 22:18:37.154760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 244/466] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:18:37 2022] POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:18:37.163793 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:37.164487 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:37.171855 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.172309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.173086 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.173549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.258945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:37.266662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2c9988b1-aa60-4543-a243-c38aee664607 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.205216 Jun 15 22:18:37.267626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 223/467] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:37 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:37.345496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:37.354515 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-526cb52f-3db7-4ef2-bb5c-25082df9d4e3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.194902 Jun 15 22:18:37.355115 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 245/468] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:37 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:37.751181 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:37.751733 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:37.759134 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.759500 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.760507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.760983 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.766453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:37.833036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-40438a7a-b173-4f6e-b9cd-88c116086886 req-d2d6d94f-233a-406b-aaea-64b02fb57105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2cc42c-43f5-437a-89a9-94a1609e986f", "name": "network-vif-plugged", "status": "completed", "tag": "dfdc84d8-1923-419b-b5e6-bcaa18ced6d3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:37.842033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-40438a7a-b173-4f6e-b9cd-88c116086886 req-d2d6d94f-233a-406b-aaea-64b02fb57105 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:37.842476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-40438a7a-b173-4f6e-b9cd-88c116086886 req-d2d6d94f-233a-406b-aaea-64b02fb57105 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:37.855488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-40438a7a-b173-4f6e-b9cd-88c116086886 req-d2d6d94f-233a-406b-aaea-64b02fb57105 service nova] Creating event network-vif-plugged:dfdc84d8-1923-419b-b5e6-bcaa18ced6d3 for instance 5e2cc42c-43f5-437a-89a9-94a1609e986f on hv-cinder-83538 Jun 15 22:18:37.861002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-40438a7a-b173-4f6e-b9cd-88c116086886 req-d2d6d94f-233a-406b-aaea-64b02fb57105 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031504 Jun 15 22:18:37.861654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 246/469] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:18:37.946051 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:37.954828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bb91e78b-7a1e-4315-bbd6-b2339640e80f tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1512 microversion: 2.1 time: 0.207737 Jun 15 22:18:37.955427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 224/470] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:37 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:38.293231 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:38.294180 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:38.306605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:38.307609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:38.309127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:38.309866 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:38.372655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:38.373254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:38.381232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:38.381530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:38.382650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:38.383126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:38.475113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:38.489545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6db4de82-0ffe-4a0d-9963-c13d6d75726e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.205311 Jun 15 22:18:38.490773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 247/471] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:38 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:38.546563 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:38.555674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-30da4aa2-9353-4396-8a8c-115a507446e8 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.187020 Jun 15 22:18:38.556270 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 225/472] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:38 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:38.972228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:38.974125 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:38.982053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:38.982506 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:38.994175 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:38.994396 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:39.167417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:39.175641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b5fd5f65-2f29-4ccc-9825-51b541a3a83b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1512 microversion: 2.1 time: 0.207528 Jun 15 22:18:39.176860 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 248/473] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:38 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:39.509150 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:39.510232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:39.519088 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:39.519761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:39.520785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:39.522371 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:39.575135 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:39.575958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:39.584556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:39.585140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:39.586079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:39.586614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:39.745599 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:39.754778 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9fd50a44-878e-48c0-a40f-63dc47bae170 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.183794 Jun 15 22:18:39.756184 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 249/474] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:39 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:39.773789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:39.781963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6c48da6e-80b1-4ff8-b5da-775efb49adf0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.277636 Jun 15 22:18:39.782557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 226/475] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:39 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:40.065268 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-03bcd126-7a10-4743-a430-cef48e94aabf req-30a42fac-03f9-4c48-81cf-23898471a956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ced019-d078-4b0d-86c0-8fba6272c7b8", "name": "network-vif-deleted", "tag": "6eceeeb6-06c6-41f7-b6c5-14f4aef9a523"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:40.075519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-03bcd126-7a10-4743-a430-cef48e94aabf req-30a42fac-03f9-4c48-81cf-23898471a956 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.076388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-03bcd126-7a10-4743-a430-cef48e94aabf req-30a42fac-03f9-4c48-81cf-23898471a956 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.082694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:40.096865 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-03bcd126-7a10-4743-a430-cef48e94aabf req-30a42fac-03f9-4c48-81cf-23898471a956 service nova] Creating event network-vif-deleted:6eceeeb6-06c6-41f7-b6c5-14f4aef9a523 for instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 on hv-cinder-83538 Jun 15 22:18:40.102531 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-03bcd126-7a10-4743-a430-cef48e94aabf req-30a42fac-03f9-4c48-81cf-23898471a956 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040914 Jun 15 22:18:40.102991 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 250/476] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:40.198992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:40.200696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:40.229026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.230590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.235960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.235960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.331953 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:40.340487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4832b3d0-1227-4241-9d0b-0dff8c8d2310 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1470 microversion: 2.1 time: 0.149200 Jun 15 22:18:40.347262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 227/477] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:40 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:40.777662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:40.778770 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:40.787435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.788310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.789125 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.789620 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.800078 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:40.801283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:40.810829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.811718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.813233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:40.813960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:40.959736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:40.968302 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-476eab47-a72c-4c75-8b87-656c0f9809bd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.195800 Jun 15 22:18:40.968901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 251/478] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:40 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:40.970283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:40.980995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-09026cdc-6248-4ced-96a1-f37cd1b49191 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.185127 Jun 15 22:18:40.981464 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 228/479] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:40 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:41.359608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:41.360217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:41.367075 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:41.367523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:41.368330 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:41.368813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:41.402521 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:41.402975 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:41.403432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'fault' on Instance uuid 37ced019-d078-4b0d-86c0-8fba6272c7b8 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:41.449082 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:41.457694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ec0907ed-134f-4d5a-9095-25b8e8667ce0 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1308 microversion: 2.1 time: 0.102338 Jun 15 22:18:41.458303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 252/480] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:41 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:41.989703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:41.990308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:41.997224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:41.997696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:41.998491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:41.998923 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:42.006182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:42.006794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:42.013841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:42.014283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:42.015087 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:42.015545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:42.163007 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:42.171735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a1c83c6-c59e-467c-8e19-eb940647f17e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.188714 Jun 15 22:18:42.172327 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 229/481] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:41 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:42.175972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:42.183661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ad8b7d0c-802e-4cbe-b714-3c3ef97f6bfb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.181340 Jun 15 22:18:42.185086 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 253/482] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:42 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:42.476292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:42.476897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:42.483544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:42.484004 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:42.484781 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:42.485218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:42.515854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:42.522418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:42.522849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:42.523328 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'fault' on Instance uuid 37ced019-d078-4b0d-86c0-8fba6272c7b8 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:42.571776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:42.579820 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f7d25df4-693b-40ba-913e-9647ffcdcf1c tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1308 microversion: 2.1 time: 0.107409 Jun 15 22:18:42.580410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 230/483] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:42 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:43.190717 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:43.191428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:43.200092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.200648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.201503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.201990 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.206443 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:43.207484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:43.219308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.219910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.221069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.221706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.365351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:43.369209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:43.378028 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4c66060b-e324-442a-bf63-df31f85752b9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.192051 Jun 15 22:18:43.379161 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 254/484] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:43 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:43.379475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fe5681ab-0d55-482a-b4b9-6c0dc31a0fd6 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1371 microversion: 2.1 time: 0.180676 Jun 15 22:18:43.379641 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 231/485] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:43 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:43.598134 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:43.598697 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:43.605749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.606454 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.607253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.607696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.646372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:43.646859 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:43.647311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'fault' on Instance uuid 37ced019-d078-4b0d-86c0-8fba6272c7b8 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:43.691417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:43.700088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-96122fbe-4887-42fa-9559-348e95185b88 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1308 microversion: 2.1 time: 0.105943 Jun 15 22:18:43.700716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 255/486] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:43 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:44.396345 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:44.397283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:44.398106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:44.398277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:44.410087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.411331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.412721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.413254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.413519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.414181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.414823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.415147 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.610875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:44.623276 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-324f84ec-ad7f-4933-a20d-057e2fb68efd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1710 microversion: 2.1 time: 0.231453 Jun 15 22:18:44.623925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 232/487] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:44 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1710 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:44.631759 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:44.640825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-59c8978f-fa2c-4a7b-980b-ce71ab20ba75 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1565 microversion: 2.1 time: 0.248007 Jun 15 22:18:44.641887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 256/488] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:44 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1565 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:44.658861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:44.659347 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:44.668104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.668104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.668104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.668104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.718948 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:44.720023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:44.726541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.727078 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.728080 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.728517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.760374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a970c2fc-9a9a-416c-a8ea-1b22a10f8b31 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106307 Jun 15 22:18:44.761170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 233/489] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:18:44 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:18:44.767180 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:44.767742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:44.768092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'fault' on Instance uuid 37ced019-d078-4b0d-86c0-8fba6272c7b8 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:44.850845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:44.859630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-83445f4b-6267-4394-815f-9d58b8c97080 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1308 microversion: 2.1 time: 0.145436 Jun 15 22:18:44.860466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 257/490] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:44 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:45.084713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:45.084817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:45.091008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.091498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.092332 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.092964 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.122278 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d3566970-723a-4daf-8dac-9a75340e8877 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/ips" status: 200 len: 151 microversion: 2.20 time: 0.042268 Jun 15 22:18:45.122988 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 234/491] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Jun 15 22:18:45 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:18:45.640846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:45.641411 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:45.648866 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.649252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.650049 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.650504 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.876734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:45.877653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:45.885730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.886282 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.887129 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.887731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.896835 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:45.904046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a0e981b0-773c-428d-aa79-d58b4301dff9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1714 microversion: 2.1 time: 0.267360 Jun 15 22:18:45.904842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 258/492] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:45 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1714 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:45.914248 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d8d59142-cc8c-4086-af49-444d880429a3 req-662b31b4-482a-44ac-aff2-873753bc5fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2cc42c-43f5-437a-89a9-94a1609e986f", "tag": "dfdc84d8-1923-419b-b5e6-bcaa18ced6d3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:45.924264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d8d59142-cc8c-4086-af49-444d880429a3 req-662b31b4-482a-44ac-aff2-873753bc5fcb service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.924701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d8d59142-cc8c-4086-af49-444d880429a3 req-662b31b4-482a-44ac-aff2-873753bc5fcb service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.936088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d8d59142-cc8c-4086-af49-444d880429a3 req-662b31b4-482a-44ac-aff2-873753bc5fcb service nova] Creating event network-changed:dfdc84d8-1923-419b-b5e6-bcaa18ced6d3 for instance 5e2cc42c-43f5-437a-89a9-94a1609e986f on hv-cinder-83538 Jun 15 22:18:45.938336 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:45.938788 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:45.941000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'fault' on Instance uuid 37ced019-d078-4b0d-86c0-8fba6272c7b8 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:45.941486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d8d59142-cc8c-4086-af49-444d880429a3 req-662b31b4-482a-44ac-aff2-873753bc5fcb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 Jun 15 22:18:45.942091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 259/493] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:18:45.985066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:45.993106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c0c0ebbb-611f-4d53-8c5e-c60ea724b1cf tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 200 len: 1308 microversion: 2.1 time: 0.120602 Jun 15 22:18:45.993826 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 235/494] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:45 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:47.011328 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:47.012054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 37ced019-d078-4b0d-86c0-8fba6272c7b8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:47.019136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:47.019583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:47.020355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:47.020794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:47.038881 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] HTTP exception thrown: Instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 could not be found. Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Request method failure captured: Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 HTTP/1.1 Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlp3-N2KE-Lam6F415gW38t0_2dWJthC7L2Gdn38gzV_Ipw1JRngZJysoz3V5f0NkyQI4OjEvdbBH7KGn4tJ6ycc_DOynQhwe6lyziKLrMUGz2BTXRP3XZx4HPPs9L2HEi8BqBCePuO0MicwVNdG8Bz3r_F7P0VwPAgeHroKhJSR0rs Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 1c2773d61c84492fb70a7a59cffa6fdb Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesSnapshotTestJSON-818221989 Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:18:47.040844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1c2773d61c84492fb70a7a59cffa6fdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1c2773d61c84492fb70a7a59cffa6fdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1c2773d61c84492fb70a7a59cffa6fdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1c2773d61c84492fb70a7a59cffa6fdb", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesSnapshotTestJSON-818221989 Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 1c2773d61c84492fb70a7a59cffa6fdb Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-818221989 Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesSnapshotTestJSON-818221989-project Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c603735d259e4ea390006779d4e76575 Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesSnapshotTestJSON-818221989-project Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 could not be found. Jun 15 22:18:47.042284 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '37ced019-d078-4b0d-86c0-8fba6272c7b8'} Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 could not be found. Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:18:47.043211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 could not be found. Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 could not be found. Jun 15 22:18:47.044682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:18:47.045792 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Returning 404 to user: Instance 37ced019-d078-4b0d-86c0-8fba6272c7b8 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:18:47.045792 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8e449402-c9f6-4a41-90c5-3d960edda2d7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8" status: 404 len: 111 microversion: 2.1 time: 0.036104 Jun 15 22:18:47.045792 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 260/495] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:47 2022] GET /compute/v2.1/servers/37ced019-d078-4b0d-86c0-8fba6272c7b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 22:18:51.087776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:51.088358 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:51.096019 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:51.096484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:51.097271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:51.097714 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:51.122119 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lazy-loading 'flavor' on Instance uuid 503192ac-2c7e-41e2-821a-7ae04c7020c0 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:18:51.393115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-13a31765-0995-44f0-9296-3623ef81ec1c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/action" status: 202 len: 0 microversion: 2.20 time: 0.309144 Jun 15 22:18:51.394087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 236/496] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 15 22:18:51 2022] POST /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:18:51.402690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:51.403830 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:51.407516 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:51.412745 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:51.413210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:51.414165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:51.414503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:51.571387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:51.580714 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:51.582256 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:51.583436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a14eaaa5-299b-4015-84dd-fe8180fbcd56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.184843 Jun 15 22:18:51.583981 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 261/497] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:51 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:18:52.606777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:52.607475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:52.617209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:52.617339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:52.618998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:52.619661 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:52.825835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:52.842965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:52.844694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:52.847166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d46dff7f-5337-4b59-acd6-ea53257c9e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.247864 Jun 15 22:18:52.854395 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 237/498] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:52 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:18:53.876618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:53.877275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:53.884420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:53.884878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:53.885690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:53.886125 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:54.036724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:54.048656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:54.050408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:54.051696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-27fbf1c7-5c72-4fb7-8a7a-193ff4d86e76 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.179101 Jun 15 22:18:54.052324 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 262/499] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:53 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:18:55.071372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:55.072016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:55.079186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:55.079610 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:55.080416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:55.080849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:55.226867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:55.230916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:55.238390 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:55.240345 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:55.241248 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5c12fae7-0511-472c-ba26-5c1c04fb6a7f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.173880 Jun 15 22:18:55.241818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 238/500] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:55 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:18:56.259852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:56.260427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:56.267829 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:56.268277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:56.269143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:56.269579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:56.421925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:56.431789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:56.433506 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:56.434739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c50ce3d4-2523-4a62-ae6c-fe4d7ec74569 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.178822 Jun 15 22:18:56.435354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 263/501] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:56 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:18:57.125810 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-158478513", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "networks": [{"uuid": "9200866c-5ebf-4743-a4b5-3b5987ff8333"}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:18:57.185713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] validate_networks() for [('9200866c-5ebf-4743-a4b5-3b5987ff8333', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:18:57.453925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:57.454503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:57.461255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:57.461741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:57.462512 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:57.462948 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:57.576890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:18:57.577306 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:18:57.577815 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:18:57.578218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:18:57.578615 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:18:57.590348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:57.590785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:57.591600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:57.592149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:57.605780 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:57.609887 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Getting quotas for project 1c2773d61c84492fb70a7a59cffa6fdb. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:18:57.613914 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:57.614084 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Getting quotas for user c603735d259e4ea390006779d4e76575 and project 1c2773d61c84492fb70a7a59cffa6fdb. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:18:57.615405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:57.616557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-acb83062-8c12-4b1c-a861-cd01d287a9c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.166648 Jun 15 22:18:57.617116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 264/502] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:57 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:18:57.626134 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:18:57.628435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:18:57.677268 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-65691ad5-719a-4488-a33c-0a40fe0da4f1 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555231 Jun 15 22:18:57.678031 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 239/503] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:18:57.688006 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a2746c62-4437-45d2-b2c6-b4d74b07648e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:57.688610 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a2746c62-4437-45d2-b2c6-b4d74b07648e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:57.745081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a2746c62-4437-45d2-b2c6-b4d74b07648e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:57.752038 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a2746c62-4437-45d2-b2c6-b4d74b07648e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1218 microversion: 2.1 time: 0.067915 Jun 15 22:18:57.752674 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 265/504] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:57 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:18:58.636515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:58.637283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:58.644882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:58.645460 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:58.646367 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:58.646940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:58.774540 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:58.775132 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:58.783746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:58.784195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:58.784996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:58.785457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:58.802985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:58.812046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:58.813611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:58.814805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b348cab3-6a33-4a0d-938a-ebe4222f6050 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.182819 Jun 15 22:18:58.815596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 240/505] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:58 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:18:58.857055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:18:58.865454 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6df4f761-d29e-4464-9675-929ebed43d41 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1270 microversion: 2.1 time: 0.099833 Jun 15 22:18:58.866029 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 266/506] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:58 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:18:59.833773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:59.834933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:59.841778 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:59.842304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:59.843138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:59.843655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:59.883358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:18:59.884931 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:18:59.895307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:59.895755 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:18:59.896604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:18:59.897042 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:00.038845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:00.046824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1cec1412-f1ec-4b82-8d1d-33e924c4d054 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.167554 Jun 15 22:19:00.047420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 267/507] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:18:59 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:00.090781 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:00.099371 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:00.101221 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:00.102734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-406aa4d7-62a5-4c74-979e-df24455e748c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.273040 Jun 15 22:19:00.103280 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 241/508] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:18:59 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:00.702300 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d05fa275-2097-48d2-a1a0-fbf090915aa2 req-57fc3947-2dd7-4295-b746-fdd7b584e880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702ddcf0-814d-4fe5-a400-99d05b877f2d", "tag": "a27a656b-c6ed-4f8e-85b3-8345b6f9fd45"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:00.712631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d05fa275-2097-48d2-a1a0-fbf090915aa2 req-57fc3947-2dd7-4295-b746-fdd7b584e880 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:00.713061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d05fa275-2097-48d2-a1a0-fbf090915aa2 req-57fc3947-2dd7-4295-b746-fdd7b584e880 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:00.731539 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d05fa275-2097-48d2-a1a0-fbf090915aa2 req-57fc3947-2dd7-4295-b746-fdd7b584e880 service nova] Creating event network-changed:a27a656b-c6ed-4f8e-85b3-8345b6f9fd45 for instance 702ddcf0-814d-4fe5-a400-99d05b877f2d on hv-cinder-83538 Jun 15 22:19:00.737440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d05fa275-2097-48d2-a1a0-fbf090915aa2 req-57fc3947-2dd7-4295-b746-fdd7b584e880 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038730 Jun 15 22:19:00.738233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 268/509] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:01.064462 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:01.065192 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:01.073160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:01.073783 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:01.074594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:01.075049 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:01.122260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:01.123048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:01.129971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:01.130449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:01.131290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:01.131653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:01.150304 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:01.275950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:01.276225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:01.285562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:01.287174 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-219df521-bb3d-40bc-9242-4ff93aabca2b tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.226554 Jun 15 22:19:01.287567 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:01.287875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 242/510] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:01 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:01.288830 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-25c1f1f7-452a-4eba-9c44-4f3be76681cd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.170747 Jun 15 22:19:01.289583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 269/511] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:01 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:02.305974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:02.306581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:02.307224 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:02.307911 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:02.314531 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:02.314986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:02.315090 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:02.315491 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:02.315770 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:02.316206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:02.316303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:02.316683 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:02.460646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:02.461777 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:02.468991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5921229c-3128-4ba8-90e0-d8be549a1810 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.167472 Jun 15 22:19:02.469818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 243/512] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:02 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:02.470408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:02.472210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:02.473685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9fa2d040-8bf9-4b17-ad74-25dddf399b56 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.170481 Jun 15 22:19:02.474783 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 270/513] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:02 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:03.488166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:03.488831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:03.493348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:03.493970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:03.495803 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:03.496291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:03.497096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:03.497653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:03.500797 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:03.501247 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:03.502046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:03.502476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:03.636598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:03.640361 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:03.645591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-08e4345a-a353-4e0a-9435-edf9bdeb3599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.161234 Jun 15 22:19:03.656267 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:03.656267 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:03.656267 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b4464e10-e29f-4cb2-95a0-b6f9c1fe2647 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.165621 Jun 15 22:19:03.656722 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 271/514] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:03 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:03.656807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 244/515] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:03 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:04.664197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:04.664812 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:04.672046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:04.672474 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:04.673259 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:04.673717 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:04.678007 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:04.678726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:04.685934 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:04.686383 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:04.687169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:04.687593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:04.844697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:04.853867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:04.855387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:04.856564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a43c69dd-ffc3-4567-882a-1233fd8c411c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.182855 Jun 15 22:19:04.857130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 245/516] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:04 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:05.065005 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:05.073803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-19d5dcec-b791-401f-910d-bf9ed0c3e599 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.413389 Jun 15 22:19:05.074396 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 272/517] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:04 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:05.875718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:05.876364 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:05.884310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:05.885051 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:05.886188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:05.887133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:05.969007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-66ab7d64-a2e1-447e-a69c-e51796e86f13 req-eba547b7-6271-44f7-ba2a-08eb6724899b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702ddcf0-814d-4fe5-a400-99d05b877f2d", "name": "network-vif-plugged", "status": "completed", "tag": "a27a656b-c6ed-4f8e-85b3-8345b6f9fd45"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:05.983387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-66ab7d64-a2e1-447e-a69c-e51796e86f13 req-eba547b7-6271-44f7-ba2a-08eb6724899b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:05.983878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-66ab7d64-a2e1-447e-a69c-e51796e86f13 req-eba547b7-6271-44f7-ba2a-08eb6724899b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:06.000747 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-66ab7d64-a2e1-447e-a69c-e51796e86f13 req-eba547b7-6271-44f7-ba2a-08eb6724899b service nova] Creating event network-vif-plugged:a27a656b-c6ed-4f8e-85b3-8345b6f9fd45 for instance 702ddcf0-814d-4fe5-a400-99d05b877f2d on hv-cinder-83538 Jun 15 22:19:06.007758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-66ab7d64-a2e1-447e-a69c-e51796e86f13 req-eba547b7-6271-44f7-ba2a-08eb6724899b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043075 Jun 15 22:19:06.008595 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 273/518] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:06.051490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:06.063182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:06.064706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:06.065925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-93315c4e-ba0f-4e1e-a3e4-d11ec7d0c441 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.194304 Jun 15 22:19:06.067269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 246/519] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:05 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:06.092914 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:06.093644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:06.100503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:06.100950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:06.101758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:06.102196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:06.249787 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:06.257934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ca8eaf4a-8e75-47dd-b2d5-b7f77c83cc14 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.170481 Jun 15 22:19:06.258511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 274/520] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:06 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:07.087288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:07.087925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:07.094742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:07.095189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:07.096138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:07.096569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:07.240466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:07.249072 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:07.250593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:07.251761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f2f915ea-52ce-4dd5-b55e-43afff8c6fe6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.168960 Jun 15 22:19:07.252519 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 247/521] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:07 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:07.276156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:07.276790 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:07.284418 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:07.284975 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:07.285797 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:07.286275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:07.462036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:07.470395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a49da70b-23b7-4b6c-a63d-b0d251469113 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.198234 Jun 15 22:19:07.470994 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 275/522] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:07 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:08.270704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:08.271294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:08.273182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:08.273845 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:08.281833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:08.282353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:08.283249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:08.283682 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:08.430626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:08.443751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:08.446003 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:08.448894 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d6edd1e3-c370-40c6-8bb9-e584ffdbad92 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.182092 Jun 15 22:19:08.449872 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 248/523] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:08 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:08.490576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:08.491203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:08.494116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:08.500236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:08.500682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:08.501474 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:08.501902 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:08.636200 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:08.644082 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1d130027-d887-491d-abf4-7852462b840a tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1318 microversion: 2.1 time: 0.159376 Jun 15 22:19:08.644648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 276/524] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:08 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:09.475923 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:09.479284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:09.487627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:09.488017 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:09.488865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:09.489301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:09.640680 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:09.649143 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:09.650767 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:09.652018 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-696aeca5-91ae-4325-a393-93c736aa181a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.182144 Jun 15 22:19:09.652730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 249/525] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:09 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:09.664168 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:09.664764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:09.672429 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:09.673071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:09.673857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:09.674279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:09.831462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:09.840162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-45947fea-528f-431d-99b9-9708ad1261bb tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1507 microversion: 2.1 time: 0.179807 Jun 15 22:19:09.840819 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 277/526] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:09 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:09.858192 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6b0dcd4-afef-49e4-83f6-e93b4c683a85", "device": "/dev/sdb"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:09.859948 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:09.866952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:09.867433 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:09.868307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:09.869022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:10.172472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9f9e0b89-d0c8-453b-94bf-22c3dce55096 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "POST /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318820 Jun 15 22:19:10.173125 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 250/527] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:19:09 2022] POST /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:19:10.673365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:10.673999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:10.683418 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:10.683874 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:10.684655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:10.685078 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:10.831727 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:10.840577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:10.842216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:10.843393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e87033ae-ddff-44e4-be6a-f2941e38654e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1742 microversion: 2.20 time: 0.176411 Jun 15 22:19:10.843960 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 278/528] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:10 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:11.863968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:11.866512 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:11.873098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:11.873641 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:11.874374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:11.874858 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:12.007165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-b1d4f4ba-61de-4749-a6c3-6c9efa9201bd req-00dd6fd8-f5d5-4035-8b54-87a065d8ef39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "name": "network-vif-plugged", "status": "completed", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:12.017826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b1d4f4ba-61de-4749-a6c3-6c9efa9201bd req-00dd6fd8-f5d5-4035-8b54-87a065d8ef39 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:12.018513 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b1d4f4ba-61de-4749-a6c3-6c9efa9201bd req-00dd6fd8-f5d5-4035-8b54-87a065d8ef39 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:12.033246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:12.033985 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-b1d4f4ba-61de-4749-a6c3-6c9efa9201bd req-00dd6fd8-f5d5-4035-8b54-87a065d8ef39 service nova] Creating event network-vif-plugged:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:19:12.039136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-b1d4f4ba-61de-4749-a6c3-6c9efa9201bd req-00dd6fd8-f5d5-4035-8b54-87a065d8ef39 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035731 Jun 15 22:19:12.040406 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 279/529] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:19:12.046598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:12.048395 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:12.049853 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0732894b-2d77-441b-87d3-3149ca86db30 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1742 microversion: 2.20 time: 0.190950 Jun 15 22:19:12.050596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 251/530] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:11 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:13.078814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:13.079528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:13.086187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:13.086634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:13.087443 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:13.087869 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:13.238110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:13.247190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:13.248990 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:13.250198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-54c50022-746b-4f44-a779-0d5cef7256bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1742 microversion: 2.20 time: 0.176319 Jun 15 22:19:13.250791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 280/531] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:13 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:14.270387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:14.270951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:14.273550 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:14.280733 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:14.281095 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:14.281915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:14.282351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:14.444426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:14.459449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:14.460963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:14.462402 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-055b5fed-206d-4d60-9f0c-2a4e0bc34d12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.196219 Jun 15 22:19:14.463511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 252/532] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:14 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:15.487521 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:15.488605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:15.496583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:15.497116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:15.498008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:15.498512 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:15.753112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:15.763860 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:15.766318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:15.768203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d0a735d8-7b94-483f-bda7-e5087f8cdcdc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.284742 Jun 15 22:19:15.769496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 281/533] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:15 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:16.788157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:16.789857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:16.797148 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:16.797632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:16.798423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:16.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:16.962479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:16.974232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:16.976200 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:16.977915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6c64b029-8f6d-4e16-aa53-8811ea907cba tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.193702 Jun 15 22:19:16.980059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 253/534] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:16 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:18.004036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:18.004634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:18.013145 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:18.013700 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:18.014572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:18.015064 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:18.172970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:18.181174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:18.184638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:18.186955 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-edea0c3c-7013-470f-a321-520097891bd1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.186944 Jun 15 22:19:18.187845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 282/535] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:17 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:19.205495 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:19.206099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:19.213492 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:19.214134 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:19.216095 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:19.217355 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:19.415590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:19.423020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:19.433285 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:19.435290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:19.436823 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-883306be-cad6-4c85-84ac-f9c23cc04ec4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.235286 Jun 15 22:19:19.438165 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 254/536] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:19 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:20.455607 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:20.456202 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:20.465473 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:20.466640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:20.468670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:20.469371 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:20.622027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:20.632811 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:20.634451 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:20.636546 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4a5de450-697e-42fc-a3f6-08b6b4341434 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.184404 Jun 15 22:19:20.652432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 283/537] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:20 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:21.657466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:21.659798 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:21.674314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:21.675645 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:21.677038 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:21.677843 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:21.847612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:21.856745 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:21.858424 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:21.861232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-98568ab0-ccab-4797-a486-ca6315d80f16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.209774 Jun 15 22:19:21.862699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 255/538] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:21 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:22.883523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:22.885387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:22.888665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=48 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:22.895132 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:22.895964 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:22.897243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:22.897861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:23.066263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:23.077499 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:23.078995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:23.080158 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-199370da-4c45-486e-bb7c-cfcab7a50a15 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.202547 Jun 15 22:19:23.080785 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 284/539] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:22 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:24.100480 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:24.101121 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:24.109160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:24.109681 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:24.110643 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:24.111144 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:24.271032 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:24.280344 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:24.281963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:24.283101 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-be960629-81ce-4c92-b633-7040aed41ac7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.186694 Jun 15 22:19:24.283699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 256/540] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:24 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:25.306019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:25.306675 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:25.314877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:25.315316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:25.316227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:25.316769 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:25.474200 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:25.487501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:25.490034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:25.491787 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1018dc18-3d6d-4342-9422-3c1f144f9779 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.189983 Jun 15 22:19:25.492640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 285/541] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:25 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:26.517603 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:26.518351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:26.524983 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:26.525504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:26.526646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:26.527256 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:26.667930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:26.677071 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:26.678672 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:26.680014 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-643f11df-8a08-4c8b-813c-51ef52f51745 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1737 microversion: 2.20 time: 0.167274 Jun 15 22:19:26.680854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 257/542] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:26 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:27.698751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:27.699494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:27.707412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:27.707955 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:27.708789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:27.709273 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:27.852496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:27.861803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:27.863557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:27.864806 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e052fcfc-82f8-4eb8-824e-0f87d01512bd tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1719 microversion: 2.20 time: 0.170094 Jun 15 22:19:27.865657 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 286/543] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:27 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:28.884617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:28.885275 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:28.892354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:28.892791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:28.893712 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:28.894214 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:29.045879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:29.054615 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:29.056127 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:29.057316 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d37f6b28-6f2f-484b-a611-0364a49dab72 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1719 microversion: 2.20 time: 0.176905 Jun 15 22:19:29.057910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 258/544] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:28 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:30.012957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-1690e718-025d-4116-aa48-441e740ce5be req-290309b8-b21b-41eb-b014-9d4fc74657e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "name": "network-vif-unplugged", "status": "completed", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:30.022489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-1690e718-025d-4116-aa48-441e740ce5be req-290309b8-b21b-41eb-b014-9d4fc74657e4 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.022910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-1690e718-025d-4116-aa48-441e740ce5be req-290309b8-b21b-41eb-b014-9d4fc74657e4 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.037229 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-1690e718-025d-4116-aa48-441e740ce5be req-290309b8-b21b-41eb-b014-9d4fc74657e4 service nova] Creating event network-vif-unplugged:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:19:30.044548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-1690e718-025d-4116-aa48-441e740ce5be req-290309b8-b21b-41eb-b014-9d4fc74657e4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035440 Jun 15 22:19:30.045825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 287/545] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:19:30.080379 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:30.081829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:30.093595 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.094312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.095582 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.096257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.298741 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:30.308496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:30.310770 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:30.311973 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0857baf0-058c-43e7-b758-c24d2b0aab82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1722 microversion: 2.20 time: 0.239677 Jun 15 22:19:30.312832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 259/546] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:30 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:30.334156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bfce712-703c-423a-af76-34b187020610"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:30.334550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:30.344177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.344671 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.345472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.346057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.358987 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:30.685469 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6ba10260-7b7f-412b-8516-6341eb2fada9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.356852 Jun 15 22:19:30.686219 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 288/547] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Jun 15 22:19:30 2022] POST /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:19:30.815585 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:30.816163 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:30.822922 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.823372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.824172 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.824607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.832533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:30.833038 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:30.840883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.841354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.842220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.842646 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.960458 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8ce4bf7c-ef74-40ce-9622-122018f92651 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/action" status: 202 len: 0 microversion: 2.20 time: 0.148777 Jun 15 22:19:30.961129 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 260/548] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 15 22:19:30 2022] POST /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 22:19:30.972591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:30.973402 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:30.982792 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.983574 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:30.984282 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:30.985012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:31.043146 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lazy-loading 'services' on Instance uuid 702ddcf0-814d-4fe5-a400-99d05b877f2d {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:19:31.145995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:31.157011 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:31.159090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:31.160664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-02ed9084-e31f-4506-b1bc-df53a68bb446 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1748 microversion: 2.20 time: 0.193750 Jun 15 22:19:31.161241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 261/549] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:30 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1748 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:31.196833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-37b294b8-eb35-49ce-845f-2e4a656291e7 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "DELETE /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d/os-volume_attachments/f6b0dcd4-afef-49e4-83f6-e93b4c683a85" status: 202 len: 0 microversion: 2.1 time: 0.371191 Jun 15 22:19:31.198174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 289/550] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:19:30 2022] DELETE /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d/os-volume_attachments/f6b0dcd4-afef-49e4-83f6-e93b4c683a85 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:19:32.185214 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:32.186341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:32.194756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:32.195502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:32.197059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:32.197677 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:32.359296 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:32.360155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:32.368057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:32.368709 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:32.370194 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:32.371165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:32.407657 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:19:32.517980 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-013461cd-d573-470f-ba28-0bc5c67e3cf5 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "DELETE /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 204 len: 0 microversion: 2.1 time: 0.162093 Jun 15 22:19:32.519515 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 290/551] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:19:32 2022] DELETE /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 22:19:32.528607 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:32.530121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:32.538490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:32.538976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:32.539761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:32.540196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:32.631217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:32.643915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:32.645559 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:32.646597 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b744011d-9896-4e91-8088-1e72bef0f991 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1748 microversion: 2.20 time: 0.466904 Jun 15 22:19:32.647160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 262/552] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:32 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1748 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:32.699850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:32.708196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0ffa91a5-d40e-42bc-aa16-b7201a826447 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1513 microversion: 2.1 time: 0.184143 Jun 15 22:19:32.708769 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 291/553] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:32 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:33.668394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:33.669023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:33.675778 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:33.676209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:33.676951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:33.677440 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:33.726048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:33.726662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:33.734187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:33.734611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:33.735383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:33.735820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:33.813667 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:33.822522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:33.824060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:33.825316 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-53a1d83f-6574-4890-b9d1-d2377da5fd27 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1750 microversion: 2.20 time: 0.160998 Jun 15 22:19:33.825913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 263/554] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:33 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:33.866592 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:33.875122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b7743913-86e0-497b-ab70-2f68e8313d1e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1513 microversion: 2.1 time: 0.152961 Jun 15 22:19:33.875669 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 292/555] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:33 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:34.847609 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:34.848594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:34.859065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:34.863865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:34.864815 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:34.865372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:34.898251 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:34.899656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:34.907542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:34.907987 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:34.909126 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:34.909857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:35.070175 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c603735d259e4ea390006779d4e76575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2773d61c84492fb70a7a59cffa6fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:35.092325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-87d1d4fa-efed-45fc-ab92-76c23268da5e tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 200 len: 1513 microversion: 2.1 time: 0.197619 Jun 15 22:19:35.093872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 293/556] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:34 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:35.177707 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:35.186955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:35.188514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:35.189159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-6552ad90-880e-414b-9a8f-3ec49bd520be req-4a2b0208-7c0c-4cb7-8e31-86cf910dfa71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702ddcf0-814d-4fe5-a400-99d05b877f2d", "name": "network-vif-deleted", "tag": "a27a656b-c6ed-4f8e-85b3-8345b6f9fd45"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:35.189706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c0e329ca-5a4d-4d98-a527-59b0f6754f1e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1750 microversion: 2.20 time: 0.349158 Jun 15 22:19:35.190293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 264/557] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:34 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1750 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:35.197706 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6552ad90-880e-414b-9a8f-3ec49bd520be req-4a2b0208-7c0c-4cb7-8e31-86cf910dfa71 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:35.198164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6552ad90-880e-414b-9a8f-3ec49bd520be req-4a2b0208-7c0c-4cb7-8e31-86cf910dfa71 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:35.210809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-6552ad90-880e-414b-9a8f-3ec49bd520be req-4a2b0208-7c0c-4cb7-8e31-86cf910dfa71 service nova] Creating event network-vif-deleted:a27a656b-c6ed-4f8e-85b3-8345b6f9fd45 for instance 702ddcf0-814d-4fe5-a400-99d05b877f2d on hv-cinder-83538 Jun 15 22:19:35.216385 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-6552ad90-880e-414b-9a8f-3ec49bd520be req-4a2b0208-7c0c-4cb7-8e31-86cf910dfa71 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Jun 15 22:19:35.217246 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 294/558] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:19:36.109631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:36.110286 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] [instance: 702ddcf0-814d-4fe5-a400-99d05b877f2d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:36.117240 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:36.117727 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:36.118527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:36.119443 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:36.133882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] HTTP exception thrown: Instance 702ddcf0-814d-4fe5-a400-99d05b877f2d could not be found. Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Request method failure captured: Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d HTTP/1.1 Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlp3-N2KE-Lam6F415gW38t0_2dWJthC7L2Gdn38gzV_Ipw1JRngZJysoz3V5f0NkyQI4OjEvdbBH7KGn4tJ6ycc_DOynQhwe6lyziKLrMUGz2BTXRP3XZx4HPPs9L2HEi8BqBCePuO0MicwVNdG8Bz3r_F7P0VwPAgeHroKhJSR0rs Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 1c2773d61c84492fb70a7a59cffa6fdb Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesSnapshotTestJSON-818221989 Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:19:36.135562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1c2773d61c84492fb70a7a59cffa6fdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1c2773d61c84492fb70a7a59cffa6fdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1c2773d61c84492fb70a7a59cffa6fdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1c2773d61c84492fb70a7a59cffa6fdb", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesSnapshotTestJSON-818221989 Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 1c2773d61c84492fb70a7a59cffa6fdb Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-818221989 Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesSnapshotTestJSON-818221989-project Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c603735d259e4ea390006779d4e76575 Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesSnapshotTestJSON-818221989-project Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 702ddcf0-814d-4fe5-a400-99d05b877f2d could not be found. Jun 15 22:19:36.137114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '702ddcf0-814d-4fe5-a400-99d05b877f2d'} Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702ddcf0-814d-4fe5-a400-99d05b877f2d could not be found. Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:19:36.138673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702ddcf0-814d-4fe5-a400-99d05b877f2d could not be found. Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702ddcf0-814d-4fe5-a400-99d05b877f2d could not be found. Jun 15 22:19:36.140576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:36.142497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] Returning 404 to user: Instance 702ddcf0-814d-4fe5-a400-99d05b877f2d could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:19:36.142497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d1aec37a-ca1c-4d2a-82ca-bc0fb209a043 tempest-VolumesSnapshotTestJSON-818221989 tempest-VolumesSnapshotTestJSON-818221989-project] 10.222.0.55 "GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d" status: 404 len: 111 microversion: 2.1 time: 0.031743 Jun 15 22:19:36.142497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 265/559] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:36 2022] GET /compute/v2.1/servers/702ddcf0-814d-4fe5-a400-99d05b877f2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:19:36.209696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:36.210557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:36.217629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:36.218077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:36.218870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:36.219310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:36.471821 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:36.492207 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:36.495350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:36.497728 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7eb4ef4d-47b5-47d5-9016-bcd56fafff0b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.293213 Jun 15 22:19:36.498901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 295/560] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:36 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:37.522131 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:37.523522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:37.538569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:37.539908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:37.541761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:37.543138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:37.780807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:37.817501 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:37.819782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:37.821421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4320f045-cbe4-41be-9d13-c7167d4cb11b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.307022 Jun 15 22:19:37.827761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 266/561] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:37 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:38.847442 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:38.849282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:38.857529 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:38.858313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:38.859222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:38.859726 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:39.034793 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:39.052125 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:39.054959 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:39.057031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b91cd67d-2139-43a4-8ac4-fcda94f52174 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.214867 Jun 15 22:19:39.058100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 296/562] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:38 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:40.078330 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:40.079021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:40.086005 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:40.086452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:40.087218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:40.087647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:40.296363 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:40.309894 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:40.311807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:40.313347 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bd1c87c1-44c9-464a-b487-1a71abe532fc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.239734 Jun 15 22:19:40.313931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 267/563] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:40 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:41.168734 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d59d3f8-cf78-440c-acef-22d11771e2e7"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:41.171233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:41.185052 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:41.185851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:41.187787 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:41.188545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:41.333309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:41.334817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:41.344525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:41.344525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:41.344525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:41.344525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:41.524587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:41.535681 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:41.537225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:41.538489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-921c6880-a0ca-4aa6-b6c7-5459a51df158 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.210105 Jun 15 22:19:41.539060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 268/564] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:41 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:42.565254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:42.566312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:42.573100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:42.576351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:42.578445 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:42.579107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:42.768688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:42.781240 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:42.783291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:42.784793 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-081e6f8e-a377-475f-857d-a9669e230ba0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.231264 Jun 15 22:19:42.785382 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 269/565] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:42 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:43.407574 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:43.408291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:43.419628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.420578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.422050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.422776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.456512 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a76d32d4-0d22-435f-9565-fa0937ccc28b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/ips" status: 200 len: 148 microversion: 2.1 time: 0.058118 Jun 15 22:19:43.457116 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 270/566] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:19:43 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/ips => generated 148 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:43.470632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbb44d9c-243b-4de3-a6af-5577329f653b"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:43.472178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:43.479026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.479473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.480579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.481023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.501904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:43.589868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Invalid volume: volume fbb44d9c-243b-4de3-a6af-5577329f653b is already attached to instances: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: POST /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/os-volume_attachments HTTP/1.1 Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 74 Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:19:43.591938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {"volumeAttachment": {"volumeId": "fbb44d9c-243b-4de3-a6af-5577329f653b"}} Jun 15 22:19:43.593992 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Invalid volume: volume fbb44d9c-243b-4de3-a6af-5577329f653b is already attached to instances: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'server_id': '32272089-e3c2-4bf4-b24f-afd378c89989', 'body': {'volumeAttachment': {'volumeId': 'fbb44d9c-243b-4de3-a6af-5577329f653b'}}} Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fbb44d9c-243b-4de3-a6af-5577329f653b is already attached to instances: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:43.596320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fbb44d9c-243b-4de3-a6af-5577329f653b is already attached to instances: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:43.598114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fbb44d9c-243b-4de3-a6af-5577329f653b is already attached to instances: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 400 to user: Invalid volume: volume fbb44d9c-243b-4de3-a6af-5577329f653b is already attached to instances: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6593165c-c2db-46db-9734-a0df4548462b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127759 Jun 15 22:19:43.600398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 271/567] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:19:43 2022] POST /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 22:19:43.610417 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:43.617483 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:43.627280 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.628018 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.629294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.630069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.669103 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:19:43.837821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c8a993b4-4ff2-4795-b116-5e10caa99cbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 204 len: 0 microversion: 2.1 time: 0.234033 Jun 15 22:19:43.838995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 272/568] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:19:43 2022] DELETE /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:19:43.850176 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:43.851807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:43.863935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.864676 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:43.866052 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:43.866672 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:44.064654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:44.075386 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:44.077224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:44.078659 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-68a02928-956f-43cc-8d0a-269b64af58bc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.236342 Jun 15 22:19:44.090433 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 273/569] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:43 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:44.099718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:44.100865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:44.112716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:44.113563 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:44.115079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:44.115979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:44.333945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:44.343567 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6aebb3f9-06be-416c-a86f-32ca52acde6f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.250076 Jun 15 22:19:44.343567 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 274/570] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:44 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:45.101021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:45.103502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:45.115250 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:45.125814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:45.127057 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:45.128482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:45.129224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:45.504980 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:45.522324 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:45.526277 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:45.528940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2baaf438-734e-4766-9a9d-d90d85b1d7e9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.433834 Jun 15 22:19:45.561955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 275/571] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:45 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:45.583284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:45.584359 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:45.599979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:45.600534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:45.601857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:45.602606 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:45.808033 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:45.816723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2be41a4f-1b28-4bdb-a143-4ab024ececf0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.253174 Jun 15 22:19:45.817354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 276/572] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:45 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:46.117247 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:46.118371 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:46.126360 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:46.126802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:46.127574 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:46.128237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:46.239226 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lazy-loading 'services' on Instance uuid b6aaf51e-4c52-4369-93d6-cab9d1aa1322 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:19:46.334497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bc668f83-1cf4-4d37-a1f8-7b6495874feb tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-volume_attachments/2d72742b-4834-453f-b4fd-92f945c4ba44" status: 202 len: 0 microversion: 2.1 time: 0.221081 Jun 15 22:19:46.335731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 277/573] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:19:46 2022] DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-volume_attachments/2d72742b-4834-453f-b4fd-92f945c4ba44 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:19:46.561592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:46.562293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:46.569249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:46.569732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:46.570528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:46.570974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:46.742833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:46.753857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:46.755423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:46.756662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cb30f50b-6a07-4e5b-9606-27cc3b5e71fe tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.199859 Jun 15 22:19:46.757245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 278/574] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:46 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:46.836773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:46.837415 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:46.844986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:46.845459 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:46.846264 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:46.846699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:47.076721 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:47.085257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b04d9bce-6994-4c67-9d44-60e54ec55de7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.252473 Jun 15 22:19:47.085784 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 279/575] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:46 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:47.777189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:47.778060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:47.785491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:47.785972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:47.786766 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:47.787172 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:47.992665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:48.002688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:48.004258 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:48.005536 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d3a4c1d5-f89f-4b27-8a27-8c8c433c1e7b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.233934 Jun 15 22:19:48.006229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 280/576] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:47 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:48.104423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:48.105114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:48.112246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:48.112700 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:48.113520 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:48.113955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:48.266749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:48.275046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cd1867ee-bd0e-4d6d-ac29-8a988c1eaed3 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.174645 Jun 15 22:19:48.275641 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 281/577] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:48 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:49.026435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:49.027293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:49.034785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:49.035230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:49.036042 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:49.036459 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:49.200159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:49.209936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:49.211321 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:49.212514 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-24fd26d6-fb01-4a95-b2f2-93a5afbfedb2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.190320 Jun 15 22:19:49.213045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 282/578] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:49 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:49.299426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:49.300607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:49.311748 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:49.312416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:49.313811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:49.314462 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:49.465529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:49.473891 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dce1807d-b35d-45c1-90f9-4399152e1b4a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.181820 Jun 15 22:19:49.474477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 283/579] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:49 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:50.241635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:50.242252 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:50.250082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:50.250384 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:50.251166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:50.251591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:50.423796 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:50.439630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:50.441602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:50.443000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1eb77412-cd5b-4b2b-81bb-efe6a380a699 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.206960 Jun 15 22:19:50.443693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 284/580] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:50 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:50.501461 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:50.502093 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:50.509524 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:50.510022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:50.510905 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:50.511881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:50.665195 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:50.669641 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:50.675472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aec13113-a8f0-49ca-9fbb-704451775486 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.181134 Jun 15 22:19:50.676261 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 285/581] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:50 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:51.067692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fcf78030-bc5a-4c6d-a548-c8dbb6600161 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.904012 Jun 15 22:19:51.068657 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 297/582] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:19:41 2022] POST /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments => generated 194 bytes in 9906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:51.469783 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:51.469783 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:51.480503 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:51.490786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:51.493712 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:51.495326 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:51.691809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:51.697697 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:51.698472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:51.710059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:51.711465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:51.712128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:51.712574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:51.791236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:51.802763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:51.803067 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:51.805841 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3dc2661d-6215-4228-8f40-4e5fa1445a16 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.343520 Jun 15 22:19:51.805841 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 286/583] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:51 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:51.856558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:51.864450 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c5c8b6f8-2b0a-420c-b263-6ef7c998307c tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1679 microversion: 2.1 time: 0.174132 Jun 15 22:19:51.865034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 298/584] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:51 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:52.816848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2a72326a-9ac8-430e-94b7-98d0cf383ab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:52.823816 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a72326a-9ac8-430e-94b7-98d0cf383ab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:52.824309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a72326a-9ac8-430e-94b7-98d0cf383ab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:52.831447 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:52.833186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:52.843952 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:52.845244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:52.846225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:52.846784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:52.890207 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=6,nova_cell1:UPDATE=7 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:52.916869 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2a72326a-9ac8-430e-94b7-98d0cf383ab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Going to try to stop instance {{(pid=117630) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 22:19:52.978725 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2a72326a-9ac8-430e-94b7-98d0cf383ab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action" status: 202 len: 0 microversion: 2.1 time: 0.166270 Jun 15 22:19:52.979356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 287/585] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:19:52 2022] POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:19:52.986657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:52.987431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:53.014900 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:53.016197 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:53.019205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:53.020823 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:53.099038 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:53.110311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:53.113958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:53.116137 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8050af40-7ab3-4eee-ba3e-bf5c4b29b5a6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.290933 Jun 15 22:19:53.117169 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 299/586] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:52 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:53.134376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-7100794f-5ae9-4dcf-a9ba-0116940a0b18 req-cea81ea7-8d73-4721-a316-d794dba9a07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32272089-e3c2-4bf4-b24f-afd378c89989", "name": "network-vif-deleted", "tag": "989aa53e-9f3f-433e-ae52-6b4be9f96a94"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:53.143666 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:53.154313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b8071929-ab76-4385-ac85-4ba49b2e4672 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 200 len: 1325 microversion: 2.1 time: 0.173466 Jun 15 22:19:53.163023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 288/587] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:52 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 1325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:53.169359 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:53.173257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:53.179972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:53.180477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:53.181294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:53.181766 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:53.185938 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7100794f-5ae9-4dcf-a9ba-0116940a0b18 req-cea81ea7-8d73-4721-a316-d794dba9a07d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:53.186506 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7100794f-5ae9-4dcf-a9ba-0116940a0b18 req-cea81ea7-8d73-4721-a316-d794dba9a07d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:53.237782 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-7100794f-5ae9-4dcf-a9ba-0116940a0b18 req-cea81ea7-8d73-4721-a316-d794dba9a07d service nova] Creating event network-vif-deleted:989aa53e-9f3f-433e-ae52-6b4be9f96a94 for instance 32272089-e3c2-4bf4-b24f-afd378c89989 on hv-cinder-83538 Jun 15 22:19:53.251034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-7100794f-5ae9-4dcf-a9ba-0116940a0b18 req-cea81ea7-8d73-4721-a316-d794dba9a07d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131934 Jun 15 22:19:53.252790 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 300/588] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:53.364138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:53.374531 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d05e95b0-0b53-4a3d-b78d-5d28eeb91dbd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.209889 Jun 15 22:19:53.375444 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 289/589] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:53 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:54.135848 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:54.138102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:54.148217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:54.148839 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:54.150143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:54.150635 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:54.188555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:54.191166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:54.200036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:54.200949 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:54.201877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:54.202357 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:54.222282 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 HTTP/1.1 Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:19:54.224453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:19:54.226205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '32272089-e3c2-4bf4-b24f-afd378c89989'} Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:19:54.226925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:19:54.228132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:19:54.233634 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:19:54.234811 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5b48d285-d585-4d13-8570-4874be76ed0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 404 len: 111 microversion: 2.1 time: 0.055006 Jun 15 22:19:54.235936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 290/590] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:54 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:19:54.248184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-51e4b650-53a7-4399-9bb8-3e12b3220495 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '.version_select at 0x7f99dbb4b040>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:54.290395 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-51e4b650-53a7-4399-9bb8-3e12b3220495 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283658027" status: 202 len: 0 microversion: 2.1 time: 0.047425 Jun 15 22:19:54.291816 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 291/591] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 15 22:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283658027 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 22:19:54.381107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:54.393443 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:54.394538 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:54.396107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:54.397678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:54.398880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f8771e89-addb-45ab-9c27-4ea2e3a3ab8d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.267529 Jun 15 22:19:54.404309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 301/592] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:54 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:54.409544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:54.410202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:54.411335 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:54.415993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:54.701012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:54.713478 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-222cf427-b6ee-4f45-8df9-1b86b3cf6922 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.324395 Jun 15 22:19:54.715186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 292/593] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:54 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:55.288362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:55.289003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:55.297362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.297704 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.298494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.298929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.393124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lazy-loading 'services' on Instance uuid 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:19:55.422627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:55.423239 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:55.430454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.430896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.431679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.432114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.495662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-77989a43-52a9-4305-972f-fdae03a28748 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments/fbb44d9c-243b-4de3-a6af-5577329f653b" status: 202 len: 0 microversion: 2.1 time: 0.210976 Jun 15 22:19:55.499988 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 302/594] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:19:55 2022] DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments/fbb44d9c-243b-4de3-a6af-5577329f653b => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:19:55.506959 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:55.508067 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:55.515395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.516279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.517438 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.518055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.555574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-612e3db7-2ad5-4882-b713-49b0af58c677 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053225 Jun 15 22:19:55.557471 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 303/595] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:19:55 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:55.583172 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:19:55.584383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:55.592558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.593148 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.594152 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.594562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.622060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'flavor' on Instance uuid 5e2cc42c-43f5-437a-89a9-94a1609e986f {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:19:55.657257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:55.669159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:55.671099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:55.672783 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b9f813ce-0284-4e57-b610-a2aa95abfa32 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.254198 Jun 15 22:19:55.674199 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 293/596] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:55 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:55.732634 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:55.732634 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:55.741966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.742628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.743551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.744170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.786957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-08be971e-6139-49c6-9c3e-40ae59ffd0a4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/action" status: 200 len: 32 microversion: 2.1 time: 0.208089 Jun 15 22:19:55.787196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 304/597] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:19:55 2022] POST /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 22:19:55.797950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:55.798691 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:55.805977 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.806534 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.807474 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:55.808070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:55.911639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:55.919946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-17b71df9-515f-4048-9a91-4f52dedbbffa tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.191777 Jun 15 22:19:55.920533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 294/598] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:55 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:55.983867 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:55.994952 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4be08fb8-d032-4bf7-b3c4-406bb6d8138e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.201450 Jun 15 22:19:55.995579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 305/599] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:55 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:56.568233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:56.569234 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:56.576774 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:56.577223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:56.578029 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:56.578453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:56.612049 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4b2c4bb8-2a2e-4f19-87d5-265e01e076d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047827 Jun 15 22:19:56.612640 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 295/600] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:19:56 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:19:56.696457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:56.697074 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:56.704354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:56.704779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:56.705580 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:56.705998 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:56.850805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:56.860408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:56.861967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:56.863160 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c6f3cd6e-6362-4214-89c8-4d84c876533b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.170856 Jun 15 22:19:56.863738 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 306/601] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:56 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:56.944593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:56.945211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:56.952062 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:56.952520 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:56.953309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:56.953771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.013296 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:57.013924 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:57.020715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.021159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.022060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.022511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.144044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:57.159466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-37e9616d-d1be-4e39-9be6-104b1445f140 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.218697 Jun 15 22:19:57.161616 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 296/602] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:56 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:57.206558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:57.216243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8c8e29f9-4612-4147-bfcb-5cbb152917a8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.207239 Jun 15 22:19:57.216834 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 307/603] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:57 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:57.631465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:57.632753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:57.643325 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.644048 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.645045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.645617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.682323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-52b3a8cc-7fcb-4d7a-9112-db117ce95de1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059550 Jun 15 22:19:57.683016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 297/604] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:19:57 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:19:57.782901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:57.783538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:57.793636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.794432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.795802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.796609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.832422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:19:57.886068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:57.886958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:57.898260 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.898911 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.900411 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.901229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.938147 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-63551b8e-760d-4e19-ad50-4173de5d564d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 204 len: 0 microversion: 2.1 time: 0.158635 Jun 15 22:19:57.939631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 308/605] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:19:57 2022] DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:19:57.956976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:57.958469 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:57.970710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.971880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:57.973656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:57.974265 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:58.094462 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:58.112636 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:58.116739 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:58.120128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0d0490b2-f093-4aa8-84da-c119e124200e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.240753 Jun 15 22:19:58.121609 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 298/606] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:57 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:19:58.183450 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:58.183969 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:58.184929 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:58.192583 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:58.193369 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:58.194372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:58.195138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:58.197709 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4a2b53a0-bece-4eef-8e42-6a5c64d17cdf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1679 microversion: 2.1 time: 0.249614 Jun 15 22:19:58.199076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 309/607] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:57 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:58.244341 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:58.245281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:58.257020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:58.258416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:58.259535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:58.260122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:58.369974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:58.384192 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-acd328c4-0501-4995-bc56-02d01d6cf6f5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.204905 Jun 15 22:19:58.385363 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 299/608] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:58 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:19:58.413791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:58.422673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3edd65d9-18d7-4741-acc8-7543732efeb8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.189846 Jun 15 22:19:58.423257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 310/609] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:58 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:59.140639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:59.141301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:59.148743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.149218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.150170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.150456 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.216850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:59.217524 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:59.225461 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.225929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.226726 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.227335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.304394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:59.314502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:59.316022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:59.317202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f8ff0e33-52a1-4a2e-9fb4-e92e4dc07199 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.181687 Jun 15 22:19:59.317792 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 300/610] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:19:59 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:19:59.370895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:59.379084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b8133523-9114-4daf-8deb-db5708f375ff tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1679 microversion: 2.1 time: 0.166478 Jun 15 22:19:59.379696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 311/611] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:59 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:59.411026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:59.411638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:59.418476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.418926 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.419795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.420144 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.441461 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:19:59.442067 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:19:59.449071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.449581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.450362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:19:59.450788 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:19:59.455623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:59.598704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:59.607044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4aac4d60-8408-45eb-9f13-4f20fdfdf3fe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.199911 Jun 15 22:19:59.608336 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 301/612] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:59 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:19:59.610404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:19:59.618969 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b9cdf6f5-95c5-4dd0-a1fc-6774f0a1deb4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.181600 Jun 15 22:19:59.619551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 312/613] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:19:59 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:00.155208 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-25cc532a-945d-45b4-aefc-dfe0c952ecec req-d850347d-8f2e-4d4c-8a56-f7f8f59bdeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "name": "network-vif-plugged", "status": "completed", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:00.166940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-25cc532a-945d-45b4-aefc-dfe0c952ecec req-d850347d-8f2e-4d4c-8a56-f7f8f59bdeb5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.167803 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-25cc532a-945d-45b4-aefc-dfe0c952ecec req-d850347d-8f2e-4d4c-8a56-f7f8f59bdeb5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.181546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-25cc532a-945d-45b4-aefc-dfe0c952ecec req-d850347d-8f2e-4d4c-8a56-f7f8f59bdeb5 service nova] Creating event network-vif-plugged:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:20:00.188505 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-25cc532a-945d-45b4-aefc-dfe0c952ecec req-d850347d-8f2e-4d4c-8a56-f7f8f59bdeb5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039636 Jun 15 22:20:00.189492 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 302/614] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:00.335678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:00.336586 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:00.345068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.345669 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.346467 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.346882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.400300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:00.401482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:00.413732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.414611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.416801 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.418544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.555712 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:00.559049 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:00.563327 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:00.575679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:00.578405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6f2e4ae4-ead7-4c74-a7f2-9966dea7829b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1611 microversion: 2.1 time: 0.182863 Jun 15 22:20:00.579936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 303/615] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:00 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1611 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:00.590183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:00.592139 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b3209abe-c4c6-4db0-bcfd-2ea784ef22c1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.260751 Jun 15 22:20:00.596628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 313/616] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:00 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:00.625185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:00.626078 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:00.636491 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:00.637409 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:00.644789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.645583 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.646596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.647485 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.653093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.654325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.657003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:00.658274 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:00.835130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:00.848659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d4a0d827-3ea8-49de-a291-72c9d1339945 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.216206 Jun 15 22:20:00.849282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 314/617] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:00 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:01.052528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-dfc4d2f9-5914-49ef-b0d3-77968307b2b2 req-5b336a27-7f79-4e12-a36b-5bc04e6c78b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c2ed2d-ebef-45a1-a6e7-4b624b642c27", "name": "network-vif-deleted", "tag": "310ea2f0-df91-4235-8abb-98fd6be92641"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:01.061351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-dfc4d2f9-5914-49ef-b0d3-77968307b2b2 req-5b336a27-7f79-4e12-a36b-5bc04e6c78b5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.061817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-dfc4d2f9-5914-49ef-b0d3-77968307b2b2 req-5b336a27-7f79-4e12-a36b-5bc04e6c78b5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.062043 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:01.072298 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1b25ca00-b8af-4a00-ac91-e947d16284cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.451569 Jun 15 22:20:01.074102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-dfc4d2f9-5914-49ef-b0d3-77968307b2b2 req-5b336a27-7f79-4e12-a36b-5bc04e6c78b5 service nova] Creating event network-vif-deleted:310ea2f0-df91-4235-8abb-98fd6be92641 for instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 on hv-cinder-83538 Jun 15 22:20:01.079427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-dfc4d2f9-5914-49ef-b0d3-77968307b2b2 req-5b336a27-7f79-4e12-a36b-5bc04e6c78b5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Jun 15 22:20:01.080360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 315/618] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:01.083013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 304/619] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:00 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:01.604032 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:01.605405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:01.616285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.617184 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.617481 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:01.618340 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:01.619209 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.619857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.629298 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.629776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.631295 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.631740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.668784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.670659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.672027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lazy-loading 'fault' on Instance uuid 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:20:01.728215 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:01.737507 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-74f368f5-dc4c-4ce1-8275-794e1dd368b7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 200 len: 1328 microversion: 2.1 time: 0.137711 Jun 15 22:20:01.738784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 316/620] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:01 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:01.806998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:01.817563 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:01.819441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:01.820629 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-db54f75c-c388-46c2-9d41-14c1175897e7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.209260 Jun 15 22:20:01.821343 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 305/621] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:01 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:01.867831 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:01.868278 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:01.875601 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.876042 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:01.876808 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:01.877237 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:02.022874 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:02.031696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a1d8b6e4-12cf-421e-9cb2-9221fa45a8ca tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.167792 Jun 15 22:20:02.032487 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 317/622] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:01 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:02.099159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:02.100679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:02.115283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:02.115842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:02.116753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:02.117464 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:02.369156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:02.381534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4be11779-1d9a-4c8c-8f9d-53db508985a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.294538 Jun 15 22:20:02.383153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 306/623] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:02 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:02.760169 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:02.764604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:02.774007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:02.774513 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:02.775399 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:02.775794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:02.797772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 HTTP/1.1 Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:20:02.799449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:20:02.800751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '19c2ed2d-ebef-45a1-a6e7-4b624b642c27'} Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:20:02.801795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:20:02.802962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:02.804022 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:20:02.804022 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-89655566-5fce-4cca-8cc7-bc5a2a29d694 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 404 len: 111 microversion: 2.1 time: 0.048757 Jun 15 22:20:02.804022 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 318/624] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:02 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:20:02.810884 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c214b059-137b-41d1-894a-ff7965febb99 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '.version_select at 0x7f99db2c3820>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:02.831612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c214b059-137b-41d1-894a-ff7965febb99 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16986499" status: 202 len: 0 microversion: 2.1 time: 0.025010 Jun 15 22:20:02.832212 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 307/625] 10.222.0.55 () {58 vars in 1214 bytes} [Wed Jun 15 22:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16986499 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:20:02.844536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:02.845219 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:02.855222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:02.856489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:02.857436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:02.858079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:03.056657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:03.058448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:03.072219 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:03.074435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:03.075471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:03.076518 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:03.110884 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:03.128510 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:03.132270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:03.135901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f4857222-a752-4301-89bd-0cbf6c4e888c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1806 microversion: 2.20 time: 0.295096 Jun 15 22:20:03.137156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 319/626] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:02 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1806 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:03.400906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:03.401853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:03.411426 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:03.411804 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:03.412713 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:03.413055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:03.426120 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:03.437168 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c090e25-e3b8-4b6f-b19f-a0f04befbfeb tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.391395 Jun 15 22:20:03.447254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 308/627] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:03 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:03.556854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:03.565611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b08c13c1-518e-4dcf-8d12-1848643f9dfc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.169373 Jun 15 22:20:03.566521 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 320/628] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:03 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:04.046781 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-533b06c8-31b5-4a85-bb27-121d8ef0dc0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: .version_select at 0x7f99dbca8ee0>, body: {"keypair": {"name": "tempest-keypair-106697289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISTKiVHMTah++SVVVB31gwFTq819tAsYo3hhS4G3FO8v97FZevqXfKbtCAKbBJLpDdgz9uAYztm/3sW3vOfeVww4sKErXJhhx0wZuijd1mCBXbINceqQswFav2hsWcVeA=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:04.067507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-533b06c8-31b5-4a85-bb27-121d8ef0dc0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:20:04.076515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-533b06c8-31b5-4a85-bb27-121d8ef0dc0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:20:04.103579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-533b06c8-31b5-4a85-bb27-121d8ef0dc0f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061413 Jun 15 22:20:04.104213 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 309/629] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:20:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:20:04.156038 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:04.156905 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:04.173174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:04.173883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:04.174367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:04.174798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:04.346332 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:04.358522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:04.360153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:04.361479 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cac33f48-eccd-48a3-baeb-27fd2069ae17 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1793 microversion: 2.20 time: 0.210042 Jun 15 22:20:04.362056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 321/630] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:04 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1793 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:20:04.457710 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:04.458974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:04.468206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:04.468891 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:04.469827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:04.470350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:04.583439 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:04.585760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:04.594163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:04.594735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:04.595673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:04.596113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:04.698020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:04.714232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6f4c0a26-90a4-4055-9dfe-efb69fc18d7f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.262168 Jun 15 22:20:04.715974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 310/631] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:04 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:04.776375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:04.788265 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e38d7894-ef9a-45ae-9d72-6ade247d9d7d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.208943 Jun 15 22:20:04.789684 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 322/632] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:04 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:05.655051 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1385622120", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51970d37-d292-4c3d-bdb6-727ed5d05edc"}], "security_groups": [{"name": "tempest-securitygroup--1920140956"}], "key_name": "tempest-keypair-106697289", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:05.733121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:05.733885 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:05.741680 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:05.742337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:05.743220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:05.743800 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:05.795019 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] validate_networks() for [('51970d37-d292-4c3d-bdb6-727ed5d05edc', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:20:05.903276 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:05.912165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3834cdfa-9af4-43d1-9f7b-d4e1ffc90dd7 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.183099 Jun 15 22:20:05.912768 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 323/633] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:05 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:05.918043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:05.918654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:05.925054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:05.925540 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:05.926327 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:05.926758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:06.087000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:06.101311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3072b4af-bf7b-4a98-9cee-1e26fe00559c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.187100 Jun 15 22:20:06.102402 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 324/634] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:05 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:06.256871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:20:06.257274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:20:06.257771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:20:06.258227 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:20:06.258618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:20:06.268508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:06.268952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:06.269766 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:06.270198 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:06.287600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:20:06.292174 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:20:06.304867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:20:06.307189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:20:06.317211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:06.363360 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aa538dc8-6a4d-4457-9f0e-67dc2aa4acb8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.713379 Jun 15 22:20:06.364126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 311/635] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:20:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:20:06.374826 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-187b9667-4b22-4885-8d23-ee8e462c8f49 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:06.375405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-187b9667-4b22-4885-8d23-ee8e462c8f49 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:06.433383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-187b9667-4b22-4885-8d23-ee8e462c8f49 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:06.440398 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-187b9667-4b22-4885-8d23-ee8e462c8f49 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1241 microversion: 2.1 time: 0.069613 Jun 15 22:20:06.440989 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 325/636] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:06 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:06.937960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:06.938504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:06.945697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:06.946149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:06.946978 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:06.947381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:07.088605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:07.097867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-21527c84-cfe8-4e31-9215-95f4b3552ade tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.165169 Jun 15 22:20:07.098649 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 312/637] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:06 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:07.126611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:07.127618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:07.135036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:07.135520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:07.136407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:07.136842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:07.281358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:07.289584 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-91995ffc-426f-414b-993b-9f81a209aab5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.166941 Jun 15 22:20:07.290208 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 326/638] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:07 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:07.458466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:07.459301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:07.466709 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:07.467281 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:07.468163 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:07.469381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:07.552134 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:07.560307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3d97b68d-65c6-42c3-a1f3-dd2e148897a9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1311 microversion: 2.1 time: 0.105761 Jun 15 22:20:07.561263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 313/639] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:07 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:08.116962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:08.117604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:08.124404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:08.124849 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:08.125642 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:08.126044 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:08.307948 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:08.309789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:08.319272 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:08.323776 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:08.324804 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:08.325824 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:08.326496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:08.328237 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-73c96286-478a-4fa4-b2c0-71ac982d9011 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.215567 Jun 15 22:20:08.329360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 327/640] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:08 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:08.476397 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:08.490838 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5ab1e7a8-0786-4502-8826-d7ae3293d9bf tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1678 microversion: 2.1 time: 0.187040 Jun 15 22:20:08.491822 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 314/641] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:08 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:08.578999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:08.579789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:08.588351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:08.588824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:08.589648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:08.590076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:08.756112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:08.764530 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aab1d4ee-d5ab-43ce-bf62-7b6d92dc48b5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.190028 Jun 15 22:20:08.765198 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 328/642] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:08 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:09.347516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:09.348106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:09.356095 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.356533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.357334 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.357773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.508258 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:09.508836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:09.516615 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.517061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.518016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.518525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.572987 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:09.595275 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b0b853b3-f245-4f22-a61c-98ae00374662 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1736 microversion: 2.1 time: 0.252406 Jun 15 22:20:09.595874 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 315/643] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:09 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:09.707655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:09.719603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e6dd31b1-ff8b-4ed5-aeb5-6688ef81dc27 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1655 microversion: 2.1 time: 0.215216 Jun 15 22:20:09.720207 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 329/644] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:09 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1655 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:09.742144 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2e958661-4052-48c0-b598-82406fa41119 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:09.753349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2e958661-4052-48c0-b598-82406fa41119 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.757028 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2e958661-4052-48c0-b598-82406fa41119 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.783681 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:09.784305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:09.788126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2e958661-4052-48c0-b598-82406fa41119 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Going to try to start instance {{(pid=117630) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 22:20:09.790767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.791439 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.792666 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.793290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.860502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2e958661-4052-48c0-b598-82406fa41119 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action" status: 202 len: 0 microversion: 2.1 time: 0.123929 Jun 15 22:20:09.861898 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 316/645] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:20:09 2022] POST /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:20:09.877528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:09.878571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:09.891314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.892225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.893914 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:09.894718 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:09.988964 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:09.995741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:10.003678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8e8bb729-03b8-4c3a-bf4c-3ceee1d29d68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.224289 Jun 15 22:20:10.017974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 330/646] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:09 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:10.026840 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-a59bef13-1406-45ea-93eb-9f9f9996305e req-41733bb0-18ee-4ed3-bf1f-8c7829750689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1668ceea-e020-4ddb-9ba0-f7081bb6d557", "tag": "7a5309bb-e179-49cf-a40a-bdf42f81c733"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:10.043996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a59bef13-1406-45ea-93eb-9f9f9996305e req-41733bb0-18ee-4ed3-bf1f-8c7829750689 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:10.044613 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a59bef13-1406-45ea-93eb-9f9f9996305e req-41733bb0-18ee-4ed3-bf1f-8c7829750689 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:10.065274 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-a59bef13-1406-45ea-93eb-9f9f9996305e req-41733bb0-18ee-4ed3-bf1f-8c7829750689 service nova] Creating event network-changed:7a5309bb-e179-49cf-a40a-bdf42f81c733 for instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 on hv-cinder-83538 Jun 15 22:20:10.074501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-a59bef13-1406-45ea-93eb-9f9f9996305e req-41733bb0-18ee-4ed3-bf1f-8c7829750689 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053742 Jun 15 22:20:10.076142 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 331/647] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:10.153523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:10.164620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a2ea0f8-fc7d-4521-aa5b-5a0777a8e4c3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1664 microversion: 2.1 time: 0.295627 Jun 15 22:20:10.176477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 317/648] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:09 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1664 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:10.614676 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:10.615260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:10.622731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:10.623173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:10.623958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:10.624364 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:10.813486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:10.822558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9fcf23c4-15ff-4f9a-a9b1-47af095b53cc tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1716 microversion: 2.1 time: 0.212707 Jun 15 22:20:10.823192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 332/649] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:10 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1716 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:10.949404 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:10.950801 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:10.959267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:10.959884 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:10.960794 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:10.961358 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.024247 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:11.025121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:11.035730 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.036473 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.037884 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.038524 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.070899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] HTTP exception thrown: Cannot 'detach_volume' instance 5e2cc42c-43f5-437a-89a9-94a1609e986f while it is in vm_state rescued Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Request method failure captured: Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments/7d59d3f8-cf78-440c-acef-22d11771e2e7 HTTP/1.1 Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloXw0IITTlRon91G0EAcwBI5qlMcZN5dlWyaYwqJtzGgHBdrhPz3qqV_liwCSOHZLd9uE7nkL7IsTKKAH8sw92b-z7g3YwxQZkRprUFDUrhO0BHGJJg2oDbwR_bPGADhWizwNu-Rl-ymPAWSQlwe0-TJ5UGv0u1fRo4Gk-4AozYWBs Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:20:11.074579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0713040636b4408c95dcadbb9b1fe3cc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 9be9445fdbc4459da4feb7c0bc1b310f Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:20:11.076257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Cannot 'detach_volume' instance 5e2cc42c-43f5-437a-89a9-94a1609e986f while it is in vm_state rescued Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'server_id': '5e2cc42c-43f5-437a-89a9-94a1609e986f', 'id': '7d59d3f8-cf78-440c-acef-22d11771e2e7'} Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:20:11.077183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5e2cc42c-43f5-437a-89a9-94a1609e986f while it is in vm_state rescued Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5e2cc42c-43f5-437a-89a9-94a1609e986f while it is in vm_state rescued Jun 15 22:20:11.078888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:20:11.080537 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Returning 409 to user: Cannot 'detach_volume' instance 5e2cc42c-43f5-437a-89a9-94a1609e986f while it is in vm_state rescued {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:20:11.083293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-82500759-88fd-4d8c-bac0-ef111a42dfb5 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments/7d59d3f8-cf78-440c-acef-22d11771e2e7" status: 409 len: 152 microversion: 2.1 time: 0.137885 Jun 15 22:20:11.084552 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 318/650] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:20:10 2022] DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments/7d59d3f8-cf78-440c-acef-22d11771e2e7 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 22:20:11.095215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:11.095824 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:11.103667 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.104128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.105741 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.105940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.211321 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-44c0f3a8-fca9-423a-992d-190eddcd0d24 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "POST /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/action" status: 202 len: 0 microversion: 2.1 time: 0.120115 Jun 15 22:20:11.215112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:11.215959 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 319/651] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:20:11 2022] POST /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:20:11.224455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:11.225818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:11.237666 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-455178f5-ea9c-4cc3-bf16-668b79a67a7d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.218657 Jun 15 22:20:11.238767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 333/652] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:11 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:11.239374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.240033 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.243122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.243514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:11.244011 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.244155 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:11.252289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.252757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.254031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:11.254943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:11.439060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:11.451142 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-112d3b53-38ba-43e6-b309-2e092983a050 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1724 microversion: 2.1 time: 0.211190 Jun 15 22:20:11.451755 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 334/653] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:11 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:12.035777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:12.044585 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2fcd40dc-15c8-4b1d-8c83-03e70daf34b7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1664 microversion: 2.1 time: 0.826935 Jun 15 22:20:12.045236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 320/654] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:11 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1664 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:12.254550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:12.255096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:12.262962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:12.263387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:12.264195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:12.264627 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:12.415251 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:12.426036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c0d9e5cf-08b5-4eb9-9380-f5a164d96605 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.174962 Jun 15 22:20:12.426931 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 335/655] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:12 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:12.475861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:12.476448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:12.483936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:12.484386 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:12.485146 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:12.485606 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:12.490182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:12.625166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:12.633873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2fbe8143-14e4-4411-8915-c538c418b492 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1724 microversion: 2.1 time: 0.161897 Jun 15 22:20:12.634421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 321/656] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:12 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:13.063631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:13.064446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:13.071625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:13.072053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:13.072838 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:13.073254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:13.215100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:13.228634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-af9c5110-5c69-4956-b6ce-f7fdc2c7c9f6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1664 microversion: 2.1 time: 0.169398 Jun 15 22:20:13.229445 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 336/657] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:13 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:13.446840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:13.447585 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:13.455146 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:13.455723 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:13.456674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:13.457679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:13.612288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:13.619877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-68e8b6c0-d642-466c-ad68-d946d43d699f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.177366 Jun 15 22:20:13.621311 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 322/658] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:13 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:13.652389 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:13.652957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:13.659989 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:13.660428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:13.661190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:13.661653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:13.801082 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:13.810188 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-699c0b7a-e7e4-4935-a22a-c6bdf282455b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1724 microversion: 2.1 time: 0.161820 Jun 15 22:20:13.810665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 337/659] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:13 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:14.245835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:14.246468 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:14.254314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:14.254772 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:14.256133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:14.256581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:14.393765 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:14.402628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9e93f6c7-226e-4f43-9a83-90b980dbed0e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1668 microversion: 2.1 time: 0.160257 Jun 15 22:20:14.403191 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 323/660] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:14 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:14.638493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:14.639111 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:14.646786 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:14.647234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:14.648019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:14.648451 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:14.788255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:14.803504 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4479016a-aedc-4747-b0cc-233ba7b266a0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.169786 Jun 15 22:20:14.804079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 338/661] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:14 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:14.827738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:14.828344 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:14.835132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:14.835577 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:14.836351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:14.836784 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:14.979287 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:14.988028 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2a77522d-86e7-4c0f-be3a-838b20781ca4 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1724 microversion: 2.1 time: 0.164395 Jun 15 22:20:14.988607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 324/662] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:14 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:15.822116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:15.822716 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:15.830088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:15.830532 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:15.831348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:15.831779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:15.967143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:15.975040 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-60ce2950-5609-4c4a-93de-ae2f31de6e1a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.157561 Jun 15 22:20:15.975828 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 339/663] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:15 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:16.009868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:16.010472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:16.017786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:16.018245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:16.019941 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:16.020390 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:16.158793 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:16.168361 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-23f26509-2ea4-4349-98d2-a88040f91290 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1724 microversion: 2.1 time: 0.164180 Jun 15 22:20:16.178010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 325/664] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:16 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:16.232771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-a9b62484-da94-4288-a35f-675c47172198 req-5d14673c-31bd-473b-b2b3-68d2fcdbf9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1668ceea-e020-4ddb-9ba0-f7081bb6d557", "name": "network-vif-plugged", "status": "completed", "tag": "7a5309bb-e179-49cf-a40a-bdf42f81c733"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:16.242974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a9b62484-da94-4288-a35f-675c47172198 req-5d14673c-31bd-473b-b2b3-68d2fcdbf9b4 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:16.243424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a9b62484-da94-4288-a35f-675c47172198 req-5d14673c-31bd-473b-b2b3-68d2fcdbf9b4 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:16.255295 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-a9b62484-da94-4288-a35f-675c47172198 req-5d14673c-31bd-473b-b2b3-68d2fcdbf9b4 service nova] Creating event network-vif-plugged:7a5309bb-e179-49cf-a40a-bdf42f81c733 for instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 on hv-cinder-83538 Jun 15 22:20:16.260315 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-a9b62484-da94-4288-a35f-675c47172198 req-5d14673c-31bd-473b-b2b3-68d2fcdbf9b4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033768 Jun 15 22:20:16.260963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 340/665] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:20:16.992721 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:16.993286 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:16.995207 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:16.996058 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=10 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:17.003173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:17.003619 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:17.004381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:17.004915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:17.166835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:17.174655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5dad4b77-9adc-45d1-9b46-b440f6fde2d2 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.186115 Jun 15 22:20:17.175200 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 326/666] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:16 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:17.186672 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:17.191303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:17.191977 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:17.198524 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:17.198962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:17.199776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:17.200201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:17.351708 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:17.362466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3c30b09d-9e06-49e6-bdfc-bcf9c28ccf72 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1730 microversion: 2.1 time: 0.176564 Jun 15 22:20:17.363281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 341/667] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:17 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:17.383728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:17.384446 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:17.393158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:17.393774 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:17.394915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:17.395584 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:17.477802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2fa00894-3054-4bee-862f-6bfb626fbc5c tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100533 Jun 15 22:20:17.478471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 327/668] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:20:17 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:18.195094 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:18.195905 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:18.200777 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:18.205856 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:18.206551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:18.207484 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:18.208057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:18.674965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:18.683651 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7df718c1-0d64-46e5-bd8b-973b6fe6e04f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1367 microversion: 2.1 time: 0.494447 Jun 15 22:20:18.684338 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-1c847f36-f2b3-4bbe-b9f4-8fa3194c029e req-9d80a3e2-639f-4208-8742-98aaee268a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2cc42c-43f5-437a-89a9-94a1609e986f", "tag": "dfdc84d8-1923-419b-b5e6-bcaa18ced6d3"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:18.686191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 342/669] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:18 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:18.695529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1c847f36-f2b3-4bbe-b9f4-8fa3194c029e req-9d80a3e2-639f-4208-8742-98aaee268a19 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:18.696293 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1c847f36-f2b3-4bbe-b9f4-8fa3194c029e req-9d80a3e2-639f-4208-8742-98aaee268a19 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:18.709551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-1c847f36-f2b3-4bbe-b9f4-8fa3194c029e req-9d80a3e2-639f-4208-8742-98aaee268a19 service nova] Creating event network-changed:dfdc84d8-1923-419b-b5e6-bcaa18ced6d3 for instance 5e2cc42c-43f5-437a-89a9-94a1609e986f on hv-cinder-83538 Jun 15 22:20:18.715100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-1c847f36-f2b3-4bbe-b9f4-8fa3194c029e req-9d80a3e2-639f-4208-8742-98aaee268a19 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034441 Jun 15 22:20:18.716230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 328/670] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:19.702841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:19.703424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:19.710548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:19.711000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:19.711769 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:19.712204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:19.856930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:19.868240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-97af9892-8639-4673-b5a9-a2e43b48cdda tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1556 microversion: 2.1 time: 0.169316 Jun 15 22:20:19.868895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 343/671] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:19 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:19.885904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:19.886483 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:19.893029 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:19.893518 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:19.894289 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:19.894724 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:19.977462 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-19b6c46c-07dc-454e-b6e3-8315e6a43265 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096256 Jun 15 22:20:19.978064 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 329/672] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:20:19 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:20.732743 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-3623deb4-d049-4f7c-89dc-d07ce25cff47 req-95740315-2d7c-468f-be55-cddb7a679af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2cc42c-43f5-437a-89a9-94a1609e986f", "tag": "dfdc84d8-1923-419b-b5e6-bcaa18ced6d3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:20.741810 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3623deb4-d049-4f7c-89dc-d07ce25cff47 req-95740315-2d7c-468f-be55-cddb7a679af8 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:20.742245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3623deb4-d049-4f7c-89dc-d07ce25cff47 req-95740315-2d7c-468f-be55-cddb7a679af8 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:20.754360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-3623deb4-d049-4f7c-89dc-d07ce25cff47 req-95740315-2d7c-468f-be55-cddb7a679af8 service nova] Creating event network-changed:dfdc84d8-1923-419b-b5e6-bcaa18ced6d3 for instance 5e2cc42c-43f5-437a-89a9-94a1609e986f on hv-cinder-83538 Jun 15 22:20:20.759463 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-3623deb4-d049-4f7c-89dc-d07ce25cff47 req-95740315-2d7c-468f-be55-cddb7a679af8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031358 Jun 15 22:20:20.760055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 344/673] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:21.698036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-03480522-774a-4092-8ddf-5e845338f9cc req-e383e6b7-f1ba-47bd-b223-57d421a4c061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1668ceea-e020-4ddb-9ba0-f7081bb6d557", "tag": "7a5309bb-e179-49cf-a40a-bdf42f81c733"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:21.706862 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-03480522-774a-4092-8ddf-5e845338f9cc req-e383e6b7-f1ba-47bd-b223-57d421a4c061 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:21.707600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-03480522-774a-4092-8ddf-5e845338f9cc req-e383e6b7-f1ba-47bd-b223-57d421a4c061 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:21.719673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-03480522-774a-4092-8ddf-5e845338f9cc req-e383e6b7-f1ba-47bd-b223-57d421a4c061 service nova] Creating event network-changed:7a5309bb-e179-49cf-a40a-bdf42f81c733 for instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 on hv-cinder-83538 Jun 15 22:20:21.724738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-03480522-774a-4092-8ddf-5e845338f9cc req-e383e6b7-f1ba-47bd-b223-57d421a4c061 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030283 Jun 15 22:20:21.725368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 330/674] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:41.931488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:20:41.932139 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Wed Jun 15 22:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:20:42.872250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=4 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:42.873000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=72 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:42.877851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:42.878428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:42.885744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:42.886189 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:42.886943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:42.887375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:42.918508 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-358c4a32-c982-4170-a6f6-ee0c80caa393 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments/0bfce712-703c-423a-af76-34b187020610" status: 200 len: 194 microversion: 2.20 time: 0.047993 Jun 15 22:20:42.919081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 345/675] 10.222.0.55 () {60 vars in 1453 bytes} [Wed Jun 15 22:20:42 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments/0bfce712-703c-423a-af76-34b187020610 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:20:42.983734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=38 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:42.984477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=46 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:42.989305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:42.990021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:42.997886 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:42.998330 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:42.999101 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:42.999534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:43.301972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lazy-loading 'services' on Instance uuid 503192ac-2c7e-41e2-821a-7ae04c7020c0 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:20:43.390082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1155685f-06e2-4565-9ce3-8089825af088 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments/0bfce712-703c-423a-af76-34b187020610" status: 202 len: 0 microversion: 2.20 time: 0.407736 Jun 15 22:20:43.390702 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 331/676] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Jun 15 22:20:42 2022] DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments/0bfce712-703c-423a-af76-34b187020610 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:20:43.400427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:43.401721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:43.408434 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:43.409286 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:43.411097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:43.411743 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:43.444074 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4a33694e-9fd4-4f05-8759-8cada23fc60d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048497 Jun 15 22:20:43.444654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 346/677] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 15 22:20:43 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:20:44.457382 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:44.458413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:44.466503 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:44.466749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:44.467569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:44.467977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:44.501831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c648ad7c-bb9e-429b-9323-2c045372267c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049373 Jun 15 22:20:44.502413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 332/678] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 15 22:20:44 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:20:45.518060 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:45.523181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:45.534511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:45.535015 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:45.535818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:45.536254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:45.570363 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-23d2da3a-2588-44c1-82f2-1d86a285abc5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061086 Jun 15 22:20:45.570933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 347/679] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 15 22:20:45 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:45.635876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:45.636433 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:45.645855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:45.646304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:45.647361 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:45.647885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:45.674963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:20:45.759600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6db78ba3-1475-45a9-bf5b-59111c3d742c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 204 len: 0 microversion: 2.20 time: 0.127486 Jun 15 22:20:45.760202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 333/680] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 15 22:20:45 2022] DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 22:20:45.770287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:45.770814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:45.777823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:45.778275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:45.779412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:45.779841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:46.048925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:46.057099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:46.058629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:46.059813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f2b7f945-3df8-4447-a755-c2be5a865d75 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.294334 Jun 15 22:20:46.060411 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 348/681] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:45 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:47.085644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:47.086241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:47.096883 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:47.097638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:47.098655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:47.099220 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:47.259740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:47.267980 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:47.269592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:47.270761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d65e6ea1-5938-4fcb-83ff-9f1d2da6c866 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1721 microversion: 2.20 time: 0.191731 Jun 15 22:20:47.271325 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 334/682] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:47 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:48.290425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:48.291164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:48.301313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:48.301983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:48.302955 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:48.303396 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:48.370708 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:48.379573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:48.381091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:48.382263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7b9e201e-4cb4-4760-989e-004954a5c65f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 200 len: 1654 microversion: 2.20 time: 0.096607 Jun 15 22:20:48.382798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 349/683] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:48 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 1654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:48.633824 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-847515d4-8a4c-406a-b279-84f72c068cbf req-eb308770-1a42-4906-8452-689171d7507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503192ac-2c7e-41e2-821a-7ae04c7020c0", "name": "network-vif-deleted", "tag": "eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:48.644178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-847515d4-8a4c-406a-b279-84f72c068cbf req-eb308770-1a42-4906-8452-689171d7507f service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:48.644708 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-847515d4-8a4c-406a-b279-84f72c068cbf req-eb308770-1a42-4906-8452-689171d7507f service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:48.657304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-847515d4-8a4c-406a-b279-84f72c068cbf req-eb308770-1a42-4906-8452-689171d7507f service nova] Creating event network-vif-deleted:eeee2d2c-abfc-4d64-8bfd-fb8272d4f53e for instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 on hv-cinder-83538 Jun 15 22:20:48.662636 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-847515d4-8a4c-406a-b279-84f72c068cbf req-eb308770-1a42-4906-8452-689171d7507f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Jun 15 22:20:48.663758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 335/684] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:49.400682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:49.401306 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:49.408994 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:49.409662 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:49.410430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:49.410862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:49.425731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] HTTP exception thrown: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Request method failure captured: Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 HTTP/1.1 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlptW8ZKu9Mh_5uu_X2uFU9nkEO_k2xg7DgQ1QuswfmXNPgWOKrIkYfDChKlqfrTtvd3ZgXsZZ6CasVEfqj013V-4gZbdCfTZfTCMvRc-0xa6aeW9x4H6QsBOcvF-PCjLLRkUgVrq0FfCjXARvHsQeb7Zl37QfWav9UiSQZjoURT84o Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:20:49.427542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1593797d34a04b169379da1a51e18072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1593797d34a04b169379da1a51e18072", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 97aa07a49016448d9b1067ce0dbd8d99 Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:20:49.429088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '503192ac-2c7e-41e2-821a-7ae04c7020c0'} Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:20:49.429965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:20:49.431581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:20:49.432941 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Returning 404 to user: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:20:49.432941 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aa5b3ad8-07ce-47d3-ba3a-506bc0ba02a5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 404 len: 111 microversion: 2.20 time: 0.032673 Jun 15 22:20:49.432941 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 350/685] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:49 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:20:49.439863 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-988f6310-354d-4db7-9304-0eb4d1eacaa8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '.version_select at 0x7f99db2e0670>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:49.460255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-988f6310-354d-4db7-9304-0eb4d1eacaa8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609741064" status: 204 len: 0 microversion: 2.20 time: 0.024791 Jun 15 22:20:49.460971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 336/686] 10.222.0.55 () {60 vars in 1258 bytes} [Wed Jun 15 22:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609741064 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 22:20:50.178873 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c29e3603-2f2d-4fc4-8df9-ceb7c7161af1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'create', calling method: .version_select at 0x7f99db2b2430>, body: {"keypair": {"name": "tempest-keypair-2122543907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm1GXiRzzkQ3qhW/7iOVTwnQcENavypYYl1pYenHbh0ScmLkz8mDrgE4d52cofUQVPec7wKQ/cYRDC+pubfE651KjbCnNZQBNSA2iPPa+6207yU65IAsu3naUWC+mJbBg=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:50.194310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-c29e3603-2f2d-4fc4-8df9-ceb7c7161af1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for project 1593797d34a04b169379da1a51e18072. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:20:50.199071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-c29e3603-2f2d-4fc4-8df9-ceb7c7161af1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for user 97aa07a49016448d9b1067ce0dbd8d99 and project 1593797d34a04b169379da1a51e18072. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:20:50.231124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c29e3603-2f2d-4fc4-8df9-ceb7c7161af1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056164 Jun 15 22:20:50.231743 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 351/687] 10.222.0.55 () {62 vars in 1199 bytes} [Wed Jun 15 22:20:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 15 22:20:51.645516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-986319299", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30f8706e-cb6c-4f5e-8770-dbd4a3aa4e2e"}], "security_groups": [{"name": "tempest-securitygroup--2147094703"}], "key_name": "tempest-keypair-2122543907", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:51.755336 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] validate_networks() for [('30f8706e-cb6c-4f5e-8770-dbd4a3aa4e2e', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:20:52.158126 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:20:52.158555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:20:52.159203 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:20:52.159427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:20:52.159838 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:20:52.175305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:52.175867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:52.176814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:52.177484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:52.200928 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for project 1593797d34a04b169379da1a51e18072. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:20:52.205789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Getting quotas for user 97aa07a49016448d9b1067ce0dbd8d99 and project 1593797d34a04b169379da1a51e18072. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:20:52.219022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:20:52.228242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:20:52.276393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7a682df3-145f-471b-abdb-108b8f871585 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.636078 Jun 15 22:20:52.279243 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 337/688] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Jun 15 22:20:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 22:20:52.288898 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-44d51c40-b017-4ea7-8994-638ff5bccfe3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:52.289528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-44d51c40-b017-4ea7-8994-638ff5bccfe3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:52.347658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-44d51c40-b017-4ea7-8994-638ff5bccfe3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:52.355343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-44d51c40-b017-4ea7-8994-638ff5bccfe3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:52.356958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-44d51c40-b017-4ea7-8994-638ff5bccfe3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:52.358090 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-44d51c40-b017-4ea7-8994-638ff5bccfe3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1281 microversion: 2.20 time: 0.073235 Jun 15 22:20:52.358654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 352/689] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:52 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:53.377284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:53.378570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:53.385079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.385576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.387030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.387499 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.476884 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:53.487184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:53.489150 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:53.491304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2f358951-be7e-4fec-85e8-2ad08fcb3aaf tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1341 microversion: 2.20 time: 0.117917 Jun 15 22:20:53.491866 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 338/690] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:53 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1341 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:53.495927 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:53.496870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:53.506343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.507105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.508218 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.508782 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.546968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6bcff502-5f6c-4206-b610-e63ecc57b075 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055086 Jun 15 22:20:53.548271 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 353/691] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:20:53 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 22:20:53.611026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:53.611508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:53.618104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.618898 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.619689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.620286 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.647408 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:20:53.736956 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6bd1a4ae-95ee-42e9-8f88-47b27f4d8eb4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 204 len: 0 microversion: 2.1 time: 0.129618 Jun 15 22:20:53.737602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 339/692] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:20:53 2022] DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:20:53.748505 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:53.750329 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:53.756996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.757514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.758317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:53.758715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:53.904325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:53.912279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a4b314d4-2a64-47d7-9346-966ae5092cd9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1674 microversion: 2.1 time: 0.169812 Jun 15 22:20:53.912842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 354/693] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:53 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:54.514010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:54.514582 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:54.521864 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:54.522421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:54.523344 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:54.523852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:54.598250 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:54.607122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:54.617282 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:54.618920 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5bbd5e6a-03fb-4952-8e4b-2d444b701f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1339 microversion: 2.20 time: 0.111424 Jun 15 22:20:54.619743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 340/694] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:54 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:54.934727 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:54.935478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:54.942883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:54.943338 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:54.944076 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:54.944542 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:55.089069 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:55.099858 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-402caafc-c8a3-4356-ae32-a10023b59c52 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1674 microversion: 2.1 time: 0.169190 Jun 15 22:20:55.101036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 355/695] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:54 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:55.643107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:55.643659 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:55.652676 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:55.653172 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:55.654315 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:55.654737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:55.727158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:55.735549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:55.737057 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:55.738184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1287328b-e3a5-4b69-88f8-793a5eec748b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1339 microversion: 2.20 time: 0.100908 Jun 15 22:20:55.738744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 341/696] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:55 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:56.118456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:56.119037 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:56.126352 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.126806 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.127638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.128072 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.270877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:56.279543 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-df2f4d31-1fac-4b6b-91fe-992d03387578 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1674 microversion: 2.1 time: 0.165249 Jun 15 22:20:56.280133 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 356/697] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:56 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:56.719814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:56.720292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:56.727022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.727471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.728226 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.728793 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.757003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:56.757723 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:56.765049 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.765836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.766576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.767109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.822272 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'services' on Instance uuid 5e2cc42c-43f5-437a-89a9-94a1609e986f {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:20:56.912381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ed67e3fc-0189-4d81-a1fd-302c9a061f91 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments/7d59d3f8-cf78-440c-acef-22d11771e2e7" status: 202 len: 0 microversion: 2.1 time: 0.196314 Jun 15 22:20:56.913618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 342/698] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:20:56 2022] DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments/7d59d3f8-cf78-440c-acef-22d11771e2e7 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:20:56.923480 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:56.926026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:56.930389 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:56.935748 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.936352 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.937432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:56.938109 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:56.942442 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:56.946512 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:56.947992 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c1b3e1f7-0f3a-4daa-b76c-beed681a61ef tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.195643 Jun 15 22:20:56.969893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 357/699] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:56 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:56.985229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2e76ef85-f311-4943-98c4-deebceaa7584 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067182 Jun 15 22:20:56.986095 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 343/700] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:20:56 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:57.297212 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:57.297841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:57.305228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:57.305752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:57.306538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:57.306959 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:57.372027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:57.379809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8a76b81a-a2bd-41ec-8ed1-350e4d2d22ca tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1607 microversion: 2.1 time: 0.087086 Jun 15 22:20:57.380392 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 358/701] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:57 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1607 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:57.616950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:20:57.617530 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Wed Jun 15 22:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:20:57.721878 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-7ce99f7b-8dbc-4d74-bbc2-3c23d7da3bfb req-500db47d-016a-465e-9025-d26ccaaf239d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aaf51e-4c52-4369-93d6-cab9d1aa1322", "name": "network-vif-deleted", "tag": "c9c6920c-14fa-4def-95f3-a52bc33fd374"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:57.735557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7ce99f7b-8dbc-4d74-bbc2-3c23d7da3bfb req-500db47d-016a-465e-9025-d26ccaaf239d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:57.736178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7ce99f7b-8dbc-4d74-bbc2-3c23d7da3bfb req-500db47d-016a-465e-9025-d26ccaaf239d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:57.748377 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-7ce99f7b-8dbc-4d74-bbc2-3c23d7da3bfb req-500db47d-016a-465e-9025-d26ccaaf239d service nova] Creating event network-vif-deleted:c9c6920c-14fa-4def-95f3-a52bc33fd374 for instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 on hv-cinder-83538 Jun 15 22:20:57.754935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-7ce99f7b-8dbc-4d74-bbc2-3c23d7da3bfb req-500db47d-016a-465e-9025-d26ccaaf239d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 Jun 15 22:20:57.756069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 344/702] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:57.891341 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:57.891969 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:57.902099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:57.902664 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:57.904647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:57.908195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:57.948405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e23596f0-8a52-4f16-a958-3ae447d6fdd7 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/ips" status: 200 len: 148 microversion: 2.1 time: 0.176500 Jun 15 22:20:57.949520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 359/703] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:20:57 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/ips => generated 148 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:20:57.978562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:57.981892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:58.000954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:58.001982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:58.007245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.009622 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.013595 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.013784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.014118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.015109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.015548 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.018812 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.083397 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-95ed0d27-2d91-41fb-8eb2-48c3ffdd8551 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086490 Jun 15 22:20:58.084645 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 360/704] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:20:57 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:20:58.173684 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:58.174182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:58.188077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.193970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.195226 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.195842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.255642 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:20:58.287664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:58.292924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:58.306886 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:58.309915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:58.312696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-81639d7c-94e2-4a09-adb3-ce987110fddc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.348588 Jun 15 22:20:58.313768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 345/705] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:57 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:58.398873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:58.399713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:58.413086 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.413612 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.425689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.426158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.446993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-726d42f5-71c5-40ac-a2be-a45f3f7c4c68 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 204 len: 0 microversion: 2.1 time: 0.275597 Jun 15 22:20:58.449415 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 361/706] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:20:58 2022] DELETE /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:20:58.461409 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:58.462694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:58.469788 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.470574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.471554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.472168 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.488274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:58.488746 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:58.489251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lazy-loading 'fault' on Instance uuid b6aaf51e-4c52-4369-93d6-cab9d1aa1322 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:20:58.541452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:58.551302 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8d552584-1f65-42cb-9e03-ca3dec3c2f6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1328 microversion: 2.1 time: 0.157824 Jun 15 22:20:58.551882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 346/707] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:58 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:20:58.639355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:58.643676 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:58.649279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6a3ac4da-dafe-46bb-99e4-8f6300d33c0f tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1690 microversion: 2.1 time: 0.194264 Jun 15 22:20:58.650370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 362/708] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:58 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:59.331657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:59.332279 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:59.339441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.339919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.340683 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.341120 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.492713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:59.502303 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:59.503807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:59.504925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-115cda10-733f-40c4-bbbb-4775baab1172 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.177341 Jun 15 22:20:59.505490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 347/709] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:20:59 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:20:59.570876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:59.571475 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:59.579127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.579569 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.580357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.580822 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.613565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.613997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.614437 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lazy-loading 'fault' on Instance uuid b6aaf51e-4c52-4369-93d6-cab9d1aa1322 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:20:59.664175 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:59.667122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:20:59.667774 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:59.672877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-db85c045-eb2e-42d3-a5d7-d4d34d844d81 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1328 microversion: 2.1 time: 0.107787 Jun 15 22:20:59.673490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 363/710] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:59 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:59.674330 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.674793 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.675573 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.676012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.746846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1340f610-408e-4e77-8e50-574f0eb29d4f"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:59.747935 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:20:59.754217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.754635 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.755452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.755878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.813794 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:20:59.821513 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-230ffb00-e406-487b-be89-a7af19bd429b tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1690 microversion: 2.1 time: 0.158317 Jun 15 22:20:59.822114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 348/711] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:20:59 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:20:59.836089 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-328a007b-ee12-4751-a846-c2e114c5a552 req-bcf6f6d7-f2ae-4bc4-ad03-47b3c38abba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:20:59.844737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-328a007b-ee12-4751-a846-c2e114c5a552 req-bcf6f6d7-f2ae-4bc4-ad03-47b3c38abba4 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:20:59.845170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-328a007b-ee12-4751-a846-c2e114c5a552 req-bcf6f6d7-f2ae-4bc4-ad03-47b3c38abba4 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:20:59.856588 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-328a007b-ee12-4751-a846-c2e114c5a552 req-bcf6f6d7-f2ae-4bc4-ad03-47b3c38abba4 service nova] Creating event network-changed:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:20:59.861340 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-328a007b-ee12-4751-a846-c2e114c5a552 req-bcf6f6d7-f2ae-4bc4-ad03-47b3c38abba4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028842 Jun 15 22:20:59.861938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 349/712] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:00.525082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:00.525791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:00.532916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.533343 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.534149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.534570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.693176 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:00.705868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:00.707979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:00.709904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-69a97729-2c29-4486-93a9-050134a15d5e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.189409 Jun 15 22:21:00.710673 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 350/713] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:00 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:00.716188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:00.716814 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:00.723422 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.723878 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.724648 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.725081 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.756060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.756554 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.757004 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lazy-loading 'fault' on Instance uuid b6aaf51e-4c52-4369-93d6-cab9d1aa1322 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:21:00.802338 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:00.810734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-321f2db5-8dce-4eaf-b613-fb4a51325da3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 200 len: 1328 microversion: 2.1 time: 0.098928 Jun 15 22:21:00.811303 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 351/714] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:00 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:00.838298 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:00.838907 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:00.845416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.845863 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.846802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:00.847260 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:00.981730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:00.989789 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-459fbaf9-0ab0-4373-adb4-b0a9f68c6819 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1690 microversion: 2.1 time: 0.155234 Jun 15 22:21:00.990667 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 352/715] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:00 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:01.731231 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:01.731882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:01.738919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:01.739378 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:01.740250 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:01.740689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:01.896097 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:01.907053 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:01.908543 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:01.909821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-91b314b9-ae61-4d6b-b5e2-231ce65a7552 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.182770 Jun 15 22:21:01.925157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 353/716] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:01 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:01.925157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:01.925157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:01.935761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:01.936452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:01.937803 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:01.938300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:01.961368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] HTTP exception thrown: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Request method failure captured: Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 HTTP/1.1 Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloMtjSEDjj4wyTlX3Vkg8aHVJhtdyjQi-dJy8lQrVuv8QMZX-Lhi5hdf_2Xv4skwW5gOVcWFN0qOlezjpGV0a5Ojd5u8lNcW_R2DzQMWnZOVZppzh6VDcQp_hDnEEt55NB5d6Hbfp9L_B76DvWcStN91eRCBvnxXNLCBbVJ_JwTQBE Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:21:01.964466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1c37e59766f45c3a46489befb803ff3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 728f1fbe76564467b378035d0d2d3be5 Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:21:01.967439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'b6aaf51e-4c52-4369-93d6-cab9d1aa1322'} Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:01.969205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:21:01.971933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:01.974526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Returning 404 to user: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:01.974526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2c46d267-1de7-492e-a5eb-186c309f2498 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 404 len: 111 microversion: 2.1 time: 0.054084 Jun 15 22:21:01.974526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 354/717] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:01 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:01.978385 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7f51590b-b1f3-400d-b0cb-d8aaba4fcf6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '.version_select at 0x7f99db2e0b80>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:01.996916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7f51590b-b1f3-400d-b0cb-d8aaba4fcf6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171436252" status: 202 len: 0 microversion: 2.1 time: 0.022410 Jun 15 22:21:01.997533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 355/718] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 15 22:21:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171436252 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:21:02.009973 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:02.010727 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:02.020800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:02.021341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:02.022257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:02.022696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:02.043113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e429cd2f-57aa-44bd-a5de-437152595941 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.298166 Jun 15 22:21:02.043113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 364/719] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:20:59 2022] POST /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments => generated 194 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:21:02.187849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:02.213534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:02.449530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:02.458263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-933f7a57-b5fa-417a-ad8e-641bb5007721 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1690 microversion: 2.1 time: 0.452718 Jun 15 22:21:02.458841 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 356/720] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:02 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1690 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:02.941617 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:02.942256 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:02.944969 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:02.951319 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:02.951761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:02.952524 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:02.952956 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:03.171843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:03.173466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3d495c0d-3ce9-43bf-afa5-907e081d4bfe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: .version_select at 0x7f99db2b6ca0>, body: {"keypair": {"name": "tempest-keypair-476603479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEN+u0370W3U/ZzWCR9v3P2qGJvNPKs64Xo4MNk+kQVbeSOJvWHOsR0bonT9AK8Iiib8rinZL949skXqSfxzIdaddcBcDKwfuJTO52JUHTZn3TpAR0hqrMvFqtj+rWbkA=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:03.181996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:03.185154 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:03.186474 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5b6b4393-aa8c-4af7-98d0-f3bc88e6d8a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.249602 Jun 15 22:21:03.187811 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 365/721] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:02 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:03.191490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-3d495c0d-3ce9-43bf-afa5-907e081d4bfe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for project e1c37e59766f45c3a46489befb803ff3. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:21:03.196397 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-3d495c0d-3ce9-43bf-afa5-907e081d4bfe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for user 728f1fbe76564467b378035d0d2d3be5 and project e1c37e59766f45c3a46489befb803ff3. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:21:03.232253 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:03.244671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3d495c0d-3ce9-43bf-afa5-907e081d4bfe tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074764 Jun 15 22:21:03.245353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 357/722] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:21:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:03.481139 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:03.482011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:03.490551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:03.491012 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:03.491796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:03.492421 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:03.560410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-2e22f6e1-a338-47df-bc48-7f64ceeae5de req-0b20d84d-40c6-4b0d-85d3-27d7b3951c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2cc42c-43f5-437a-89a9-94a1609e986f", "name": "network-vif-deleted", "tag": "dfdc84d8-1923-419b-b5e6-bcaa18ced6d3"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:03.580274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-2e22f6e1-a338-47df-bc48-7f64ceeae5de req-0b20d84d-40c6-4b0d-85d3-27d7b3951c8b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:03.580755 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-2e22f6e1-a338-47df-bc48-7f64ceeae5de req-0b20d84d-40c6-4b0d-85d3-27d7b3951c8b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:03.608744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-2e22f6e1-a338-47df-bc48-7f64ceeae5de req-0b20d84d-40c6-4b0d-85d3-27d7b3951c8b service nova] Creating event network-vif-deleted:dfdc84d8-1923-419b-b5e6-bcaa18ced6d3 for instance 5e2cc42c-43f5-437a-89a9-94a1609e986f on hv-cinder-83538 Jun 15 22:21:03.614600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-2e22f6e1-a338-47df-bc48-7f64ceeae5de req-0b20d84d-40c6-4b0d-85d3-27d7b3951c8b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058734 Jun 15 22:21:03.617217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 358/723] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:21:03.622751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:03.635088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fb8780d2-ead8-49ac-b470-f79e262e0391 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 200 len: 1623 microversion: 2.1 time: 0.158353 Jun 15 22:21:03.636196 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 366/724] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:03 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 1623 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:04.208654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:04.210041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:04.218844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:04.235413 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:04.238381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:04.239309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:04.498262 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:04.508334 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:04.509871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:04.511154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-16413aac-f0b1-473d-99f8-83193421e834 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.306633 Jun 15 22:21:04.511759 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 359/725] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:04 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:04.653250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:04.655065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5e2cc42c-43f5-437a-89a9-94a1609e986f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:04.663077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:04.664037 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:04.665303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:04.666058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:04.684978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] HTTP exception thrown: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f could not be found. Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Request method failure captured: Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f HTTP/1.1 Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloXw0IITTlRon91G0EAcwBI5qlMcZN5dlWyaYwqJtzGgHBdrhPz3qqV_liwCSOHZLd9uE7nkL7IsTKKAH8sw92b-z7g3YwxQZkRprUFDUrhO0BHGJJg2oDbwR_bPGADhWizwNu-Rl-ymPAWSQlwe0-TJ5UGv0u1fRo4Gk-4AozYWBs Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:21:04.686950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0713040636b4408c95dcadbb9b1fe3cc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 9be9445fdbc4459da4feb7c0bc1b310f Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f could not be found. Jun 15 22:21:04.688277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '5e2cc42c-43f5-437a-89a9-94a1609e986f'} Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f could not be found. Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:04.689023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f could not be found. Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f could not be found. Jun 15 22:21:04.690289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:04.691343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Returning 404 to user: Instance 5e2cc42c-43f5-437a-89a9-94a1609e986f could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:04.691343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-46b7ecc0-f939-4c90-b970-315557b97f6a tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f" status: 404 len: 111 microversion: 2.1 time: 0.040228 Jun 15 22:21:04.691343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 367/726] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:04 2022] GET /compute/v2.1/servers/5e2cc42c-43f5-437a-89a9-94a1609e986f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:04.697782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-58ee47bd-39e8-4307-a78d-44b15eac151e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '.version_select at 0x7f99dbb0f820>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:04.733143 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-58ee47bd-39e8-4307-a78d-44b15eac151e tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409085370" status: 202 len: 0 microversion: 2.1 time: 0.039410 Jun 15 22:21:04.733976 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 360/727] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 15 22:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409085370 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:21:04.844827 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1892433705", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8775d530-af5d-47c6-94ff-035a35c09c54"}], "security_groups": [{"name": "tempest-securitygroup--1015816860"}], "key_name": "tempest-keypair-476603479", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:05.059316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] validate_networks() for [('8775d530-af5d-47c6-94ff-035a35c09c54', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:21:05.531351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:05.531994 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:05.538365 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:05.538812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:05.539578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:05.540012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:05.691056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:21:05.691796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:21:05.692400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:21:05.693225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:21:05.693872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:21:05.701223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:05.703954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:05.704602 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:05.705576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:05.706055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:05.710955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:05.712658 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:05.714104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-33156f83-9f7a-4fc2-9e67-88d9a0247225 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.187830 Jun 15 22:21:05.714885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 361/728] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:05 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:05.724015 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for project e1c37e59766f45c3a46489befb803ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:21:05.728588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Getting quotas for user 728f1fbe76564467b378035d0d2d3be5 and project e1c37e59766f45c3a46489befb803ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:21:05.740728 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:21:05.743073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:21:05.790083 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-48d6311a-294a-4e46-8409-4bd83e3f6583 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.950622 Jun 15 22:21:05.790715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 368/729] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:21:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:21:05.801203 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-687fba17-f8e0-471e-95af-6041e55e59a3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:05.801912 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-687fba17-f8e0-471e-95af-6041e55e59a3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:05.859358 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-687fba17-f8e0-471e-95af-6041e55e59a3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:05.867643 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-687fba17-f8e0-471e-95af-6041e55e59a3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1237 microversion: 2.1 time: 0.070337 Jun 15 22:21:05.868406 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 362/730] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:05 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:06.484836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ec8e7d6c-8b4a-4b18-af66-166fa2a56259 req-0b61bec3-cbd1-4320-a953-b5bdea6160f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "name": "network-vif-plugged", "status": "completed", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:06.494281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ec8e7d6c-8b4a-4b18-af66-166fa2a56259 req-0b61bec3-cbd1-4320-a953-b5bdea6160f9 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:06.494813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ec8e7d6c-8b4a-4b18-af66-166fa2a56259 req-0b61bec3-cbd1-4320-a953-b5bdea6160f9 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:06.506606 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ec8e7d6c-8b4a-4b18-af66-166fa2a56259 req-0b61bec3-cbd1-4320-a953-b5bdea6160f9 service nova] Creating event network-vif-plugged:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:21:06.513317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ec8e7d6c-8b4a-4b18-af66-166fa2a56259 req-0b61bec3-cbd1-4320-a953-b5bdea6160f9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032453 Jun 15 22:21:06.514203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 369/731] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:06.733103 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:06.733737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:06.741550 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:06.741934 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:06.742706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:06.743178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:06.887081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:06.888404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:06.888863 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:06.898012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:06.899367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:06.899832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:06.900396 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:06.900618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:06.901507 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:06.904352 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-500df0c6-670a-4736-b60c-e23a8bbfd7d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.173920 Jun 15 22:21:06.905816 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 363/732] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:06 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:06.990236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:06.998366 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-72e61b2e-76eb-4dec-8a6a-428c2dde16d5 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1289 microversion: 2.1 time: 0.116477 Jun 15 22:21:06.999471 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 370/733] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:06 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:07.923149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:07.924114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:07.931479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:07.931479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:07.932269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:07.932704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:07.949274 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:07.950425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:07.958927 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:07.959497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:07.960561 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:07.961122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:07.988396 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:21:08.077101 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-62f83399-75bf-421f-a70c-6a282d0169c9 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 204 len: 0 microversion: 2.1 time: 0.131590 Jun 15 22:21:08.078539 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 371/734] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:21:07 2022] DELETE /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:21:08.083927 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:08.084609 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:08.092056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:08.092516 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:08.093355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:08.093833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:08.146891 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:08.156526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:08.158173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:08.159300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b8a1d142-34c5-47cd-b3db-e6fbcb77ca2f tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.240153 Jun 15 22:21:08.164939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:08.168917 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 364/735] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:07 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:08.174280 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:08.175479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:08.175617 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1b42640f-4311-437c-9631-da18f81029cc tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1295 microversion: 2.1 time: 0.095696 Jun 15 22:21:08.176304 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 372/736] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:08 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:08.181201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:08.181703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:08.182519 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:08.182985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:08.411369 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:08.420199 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e81109f1-ab86-4777-add4-7f87a03af4dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1507 microversion: 2.1 time: 0.249894 Jun 15 22:21:08.420868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 365/737] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:08 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:09.178641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:09.179215 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:09.182872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:09.187104 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:09.187551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:09.188318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:09.188796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:09.194417 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:09.195045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:09.202596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:09.203059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:09.203842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:09.204278 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:09.331823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:09.340380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:09.341833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:09.342946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4ae02a05-7be7-4548-adf3-65bdce6a3045 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1407 microversion: 2.20 time: 0.168416 Jun 15 22:21:09.343059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:09.343513 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 373/738] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:09 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:09.351596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ae6b8601-09cc-4b63-958a-bd77030e6a6d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.161491 Jun 15 22:21:09.352166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 366/739] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:09 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:21:09.440987 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:09.441621 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:09.448621 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:09.449082 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:09.450555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:09.451140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:09.593946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:09.601735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-08f9c823-4ea9-42ee-996a-faeb0f675d70 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1507 microversion: 2.1 time: 0.164746 Jun 15 22:21:09.602281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 374/740] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:09 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:10.362170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:10.362927 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:10.368073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:10.368670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:10.370744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.371254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.372229 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.372657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.376438 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.376880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.377654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.378084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.506331 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:10.509877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:10.515635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:10.517105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:10.518307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c3f84606-e78d-478b-8de6-bf3e7d6e1ffb tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1599 microversion: 2.20 time: 0.160347 Jun 15 22:21:10.518868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 367/741] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:10 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:10.520109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:10.527767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd285007-3454-4ad7-94e3-f6b3387ed5e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.163504 Jun 15 22:21:10.528967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 375/742] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:10 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:10.535902 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:10.536396 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:10.542993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.543743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.544212 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.544652 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.619739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:10.620351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:10.626129 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6c8851d1-6d57-49c5-bab7-f7554e0f7967 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093953 Jun 15 22:21:10.626850 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 368/743] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Jun 15 22:21:10 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:21:10.628227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.628720 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:10.629531 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:10.629968 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:11.178673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:11.190192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a65f9892-e798-4910-abc9-c7e831d2d5dd tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1507 microversion: 2.1 time: 0.574560 Jun 15 22:21:11.191504 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 376/744] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:10 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:21:11.547829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:11.549114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:11.561742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:11.562832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:11.563833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:11.565267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:11.735181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-da3e806c-280f-4ea7-a104-ba82d457e961 req-5a00a85d-ca86-4b51-ab47-eca6101b08a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5613381-5273-4191-a2fb-be14d4a3087c", "tag": "72bdda10-0519-4860-a576-e08996f2fe0f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:11.752027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-da3e806c-280f-4ea7-a104-ba82d457e961 req-5a00a85d-ca86-4b51-ab47-eca6101b08a5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:11.752856 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-da3e806c-280f-4ea7-a104-ba82d457e961 req-5a00a85d-ca86-4b51-ab47-eca6101b08a5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:11.766857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-da3e806c-280f-4ea7-a104-ba82d457e961 req-5a00a85d-ca86-4b51-ab47-eca6101b08a5 service nova] Creating event network-changed:72bdda10-0519-4860-a576-e08996f2fe0f for instance d5613381-5273-4191-a2fb-be14d4a3087c on hv-cinder-83538 Jun 15 22:21:11.778066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-da3e806c-280f-4ea7-a104-ba82d457e961 req-5a00a85d-ca86-4b51-ab47-eca6101b08a5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168606 Jun 15 22:21:11.778066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 377/745] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:11.844069 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1340f610-408e-4e77-8e50-574f0eb29d4f"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:11.845571 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:11.854424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:11.855086 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:11.857740 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:11.858423 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:11.946668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:11.951643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Invalid volume: volume 1340f610-408e-4e77-8e50-574f0eb29d4f is already attached to instances: 1668ceea-e020-4ddb-9ba0-f7081bb6d557 Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments HTTP/1.1 Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 74 Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:21:11.953548 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {"volumeAttachment": {"volumeId": "1340f610-408e-4e77-8e50-574f0eb29d4f"}} Jun 15 22:21:11.954843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Invalid volume: volume 1340f610-408e-4e77-8e50-574f0eb29d4f is already attached to instances: 1668ceea-e020-4ddb-9ba0-f7081bb6d557 Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'server_id': '1668ceea-e020-4ddb-9ba0-f7081bb6d557', 'body': {'volumeAttachment': {'volumeId': '1340f610-408e-4e77-8e50-574f0eb29d4f'}}} Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1340f610-408e-4e77-8e50-574f0eb29d4f is already attached to instances: 1668ceea-e020-4ddb-9ba0-f7081bb6d557 Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:11.955572 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1340f610-408e-4e77-8e50-574f0eb29d4f is already attached to instances: 1668ceea-e020-4ddb-9ba0-f7081bb6d557 Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:11.957214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1340f610-408e-4e77-8e50-574f0eb29d4f is already attached to instances: 1668ceea-e020-4ddb-9ba0-f7081bb6d557 Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 400 to user: Invalid volume: volume 1340f610-408e-4e77-8e50-574f0eb29d4f is already attached to instances: 1668ceea-e020-4ddb-9ba0-f7081bb6d557 {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-59d0d7f5-25c8-4dae-b1fd-6ca6fe3be574 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116267 Jun 15 22:21:11.958820 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 378/746] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:21:11 2022] POST /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:21:12.129958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:12.151726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ff63326f-59c8-4000-841b-3f55eef05cec tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.610602 Jun 15 22:21:12.152507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 369/747] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:11 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:12.172658 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:12.174947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:12.188257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.188899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.190071 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.190843 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.210195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-052a7aac-adf4-4506-be9c-209981b36dc5 req-305911a3-3dfd-4671-a710-25199ed3a632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:12.223073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-052a7aac-adf4-4506-be9c-209981b36dc5 req-305911a3-3dfd-4671-a710-25199ed3a632 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.223744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-052a7aac-adf4-4506-be9c-209981b36dc5 req-305911a3-3dfd-4671-a710-25199ed3a632 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.241157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-052a7aac-adf4-4506-be9c-209981b36dc5 req-305911a3-3dfd-4671-a710-25199ed3a632 service nova] Creating event network-changed:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:21:12.249837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-052a7aac-adf4-4506-be9c-209981b36dc5 req-305911a3-3dfd-4671-a710-25199ed3a632 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155189 Jun 15 22:21:12.254664 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 379/748] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:21:12.260788 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:12.262190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:12.270255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.270967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.271941 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.272567 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.328319 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.328939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.329577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'fault' on Instance uuid 5b32ad40-764f-44d0-a589-d823eee5b508 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:21:12.376100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:12.385405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cbf81572-ec6a-41c0-b71a-1bea4f01dbec tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1311 microversion: 2.1 time: 0.128998 Jun 15 22:21:12.385740 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 380/749] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:12 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:12.394130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lazy-loading 'services' on Instance uuid 1668ceea-e020-4ddb-9ba0-f7081bb6d557 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:21:12.500099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c76c1e6d-836b-4b69-b903-21f920e2d1b9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments/1340f610-408e-4e77-8e50-574f0eb29d4f" status: 202 len: 0 microversion: 2.1 time: 0.344914 Jun 15 22:21:12.501529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 370/750] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:21:12 2022] DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments/1340f610-408e-4e77-8e50-574f0eb29d4f => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:21:12.510929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:12.512529 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:12.521111 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.522508 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.523503 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:12.526055 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:12.562374 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f87b3c54-feac-486c-9675-d460d0b9686b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056755 Jun 15 22:21:12.563441 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 381/751] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:21:12 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:21:13.171407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:13.172155 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:13.179128 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.179576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.180356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.180791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.323522 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:13.331225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7444cdb7-c22b-4b3e-818a-9bd606644688 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.165554 Jun 15 22:21:13.331785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 371/752] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:13 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:13.405535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:13.406167 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:13.412926 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.413414 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.414208 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.414638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.446136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.446488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.446932 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'fault' on Instance uuid 5b32ad40-764f-44d0-a589-d823eee5b508 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:21:13.489061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:13.500225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ee1472b6-8ee5-4e62-9be6-811cc5ec7186 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 200 len: 1311 microversion: 2.1 time: 0.099155 Jun 15 22:21:13.500928 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 382/753] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:13 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:13.573473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:13.574627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:13.580955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.581449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.582300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.582648 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.612902 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5061866e-0185-4969-81a8-37056eb5ada1 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Jun 15 22:21:13.613489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 372/754] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:21:13 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:13.803899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-cc1bd03c-d914-4eed-b9fe-445caedbda6d req-186232c3-1bd9-4c3d-a368-b8953207fac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b32ad40-764f-44d0-a589-d823eee5b508", "name": "network-vif-deleted", "tag": "4dc0def1-b88d-4f1c-9be4-a801af02f48a"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:13.812978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-cc1bd03c-d914-4eed-b9fe-445caedbda6d req-186232c3-1bd9-4c3d-a368-b8953207fac6 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:13.813441 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-cc1bd03c-d914-4eed-b9fe-445caedbda6d req-186232c3-1bd9-4c3d-a368-b8953207fac6 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:13.825227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-cc1bd03c-d914-4eed-b9fe-445caedbda6d req-186232c3-1bd9-4c3d-a368-b8953207fac6 service nova] Creating event network-vif-deleted:4dc0def1-b88d-4f1c-9be4-a801af02f48a for instance 5b32ad40-764f-44d0-a589-d823eee5b508 on hv-cinder-83538 Jun 15 22:21:13.830461 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-cc1bd03c-d914-4eed-b9fe-445caedbda6d req-186232c3-1bd9-4c3d-a368-b8953207fac6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 Jun 15 22:21:13.831056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 383/755] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:14.348551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.349186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.358099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.358549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.359328 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.359756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.518590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.519585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: 5b32ad40-764f-44d0-a589-d823eee5b508] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.527050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.527944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.529643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.530182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.545739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] HTTP exception thrown: Instance 5b32ad40-764f-44d0-a589-d823eee5b508 could not be found. Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Request method failure captured: Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 HTTP/1.1 Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloXw0IITTlRon91G0EAcwBI5qlMcZN5dlWyaYwqJtzGgHBdrhPz3qqV_liwCSOHZLd9uE7nkL7IsTKKAH8sw92b-z7g3YwxQZkRprUFDUrhO0BHGJJg2oDbwR_bPGADhWizwNu-Rl-ymPAWSQlwe0-TJ5UGv0u1fRo4Gk-4AozYWBs Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:21:14.547554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0713040636b4408c95dcadbb9b1fe3cc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 9be9445fdbc4459da4feb7c0bc1b310f Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 5b32ad40-764f-44d0-a589-d823eee5b508 could not be found. Jun 15 22:21:14.549091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '5b32ad40-764f-44d0-a589-d823eee5b508'} Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b32ad40-764f-44d0-a589-d823eee5b508 could not be found. Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:14.550099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b32ad40-764f-44d0-a589-d823eee5b508 could not be found. Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b32ad40-764f-44d0-a589-d823eee5b508 could not be found. Jun 15 22:21:14.551456 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:14.552634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Returning 404 to user: Instance 5b32ad40-764f-44d0-a589-d823eee5b508 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:14.552634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6812cd52-9260-411f-9957-f3735a8936ef tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508" status: 404 len: 111 microversion: 2.1 time: 0.035716 Jun 15 22:21:14.552634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 384/756] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:14 2022] GET /compute/v2.1/servers/5b32ad40-764f-44d0-a589-d823eee5b508 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:14.562146 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.563286 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.571210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.571778 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.572619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.573077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.603228 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:21:14.707216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5cca304f-07d6-4a53-b048-10ffc7cbc1d0 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "DELETE /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 204 len: 0 microversion: 2.1 time: 0.150243 Jun 15 22:21:14.708068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 385/757] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:21:14 2022] DELETE /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:21:14.717732 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.718760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.726391 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.726842 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.727628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.728254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.759742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6da6600a-b7d1-43c7-aaad-42a756f10c46 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050308 Jun 15 22:21:14.760188 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 386/758] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:21:14 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:21:14.765307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.765923 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.771872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.772346 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.773104 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.773564 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.793202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:14.802209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-31c4c7c7-be2f-49d0-9777-74aa899fc96b tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.457540 Jun 15 22:21:14.811015 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 373/759] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:14 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:14.819202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.819691 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.826618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.827948 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.829087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.829555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.859024 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:21:14.924808 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:14.932615 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e979f442-5c5a-4ea0-b559-738a54162659 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.171462 Jun 15 22:21:14.933193 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 387/760] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:14 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:14.944540 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5fb18dd6-27ad-4790-b421-c738ed6e5382 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 204 len: 0 microversion: 2.1 time: 0.128876 Jun 15 22:21:14.945424 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 374/761] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:21:14 2022] DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 22:21:14.954195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:14.954785 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:14.961182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.961688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:14.962454 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:14.962881 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:15.100788 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:15.109873 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ff6520b5-5d69-4d23-95e7-baa3e29d505f tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1680 microversion: 2.1 time: 0.159487 Jun 15 22:21:15.110565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 388/762] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:14 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:15.822581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:15.823283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:15.833247 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:15.833897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:15.835135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:15.835626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:15.868947 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:15.952604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:15.953182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:15.955787 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:15.956449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:15.962837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:15.963275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:15.964039 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:15.964465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:15.982155 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:15.990150 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aec57397-8fb0-41ab-b7f8-1f6c89bc09e4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.173669 Jun 15 22:21:15.990715 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 375/763] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:15 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:16.100348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:16.110191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2254423b-1b74-4256-b225-0ffecf5df736 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.161644 Jun 15 22:21:16.110814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 389/764] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:15 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:16.128096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:16.128711 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:16.135419 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:16.135876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:16.136828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:16.137368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:16.281251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:16.288963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e02926f1-febe-446b-b7ce-1b25d6020e4d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1680 microversion: 2.1 time: 0.164812 Jun 15 22:21:16.289600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 376/765] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:16 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:16.573174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ff5aafc2-8c04-4faa-816d-7b7b83671e6a req-3b9daacd-d5db-4e3c-bb62-495a6c16aad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5613381-5273-4191-a2fb-be14d4a3087c", "name": "network-vif-plugged", "status": "completed", "tag": "72bdda10-0519-4860-a576-e08996f2fe0f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:16.582909 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ff5aafc2-8c04-4faa-816d-7b7b83671e6a req-3b9daacd-d5db-4e3c-bb62-495a6c16aad5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:16.583428 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ff5aafc2-8c04-4faa-816d-7b7b83671e6a req-3b9daacd-d5db-4e3c-bb62-495a6c16aad5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:16.595573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ff5aafc2-8c04-4faa-816d-7b7b83671e6a req-3b9daacd-d5db-4e3c-bb62-495a6c16aad5 service nova] Creating event network-vif-plugged:72bdda10-0519-4860-a576-e08996f2fe0f for instance d5613381-5273-4191-a2fb-be14d4a3087c on hv-cinder-83538 Jun 15 22:21:16.602092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ff5aafc2-8c04-4faa-816d-7b7b83671e6a req-3b9daacd-d5db-4e3c-bb62-495a6c16aad5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032681 Jun 15 22:21:16.602700 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 390/766] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:17.008993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:17.009620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:17.016753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:17.017180 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:17.018036 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:17.018575 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:17.128795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:17.129537 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:17.136174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:17.136624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:17.137634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:17.137946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:17.170865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:17.178756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-144a2daf-1d1f-4eaa-af26-29c6ad72d736 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.173773 Jun 15 22:21:17.179335 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 377/767] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:17 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:17.283568 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:17.294591 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6c569917-8009-4361-865f-fcf26596e137 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.170477 Jun 15 22:21:17.295166 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 391/768] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:17 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:17.307412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:17.308344 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:17.314655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:17.315105 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:17.315882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:17.316313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:17.456915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:17.467877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4aba8e35-f8cc-43d7-8679-d090d6730f5a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1680 microversion: 2.1 time: 0.165314 Jun 15 22:21:17.468468 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 378/769] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:17 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:18.198095 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:18.199056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:18.209305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:18.209855 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:18.211024 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:18.211661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:18.312509 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:18.313119 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:18.319857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:18.320283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:18.321055 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:18.321516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:18.353163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:18.361713 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-da99b2aa-4b23-4bc5-bfed-717ddecbea6c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.168849 Jun 15 22:21:18.362486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 392/770] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:18 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:18.473100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:18.483330 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-39cccc23-0d1a-431e-9885-5b1d6267c3d3 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.175164 Jun 15 22:21:18.483915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 379/771] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:18 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:18.492632 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:18.493244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:18.500437 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:18.500888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:18.501754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:18.502192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:18.648187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:18.656655 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cf8de08e-e8d9-4f77-aaf9-ba094f4bfca4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1680 microversion: 2.1 time: 0.174016 Jun 15 22:21:18.657225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 393/772] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:18 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:19.380476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:19.381186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:19.388693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:19.389378 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:19.390332 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:19.390770 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:19.503156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:19.503732 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:19.510893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:19.511345 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:19.512117 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:19.512557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:19.643928 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:19.651804 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2a7e4699-b08a-428d-b8c3-6e3e6fea4bf8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1521 microversion: 2.1 time: 0.152733 Jun 15 22:21:19.652409 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 394/773] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:19 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:19.675165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:19.675776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:19.682329 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:19.682775 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:19.684164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:19.684984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:19.769545 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:19.777505 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5bc4fb1e-c825-4ae3-bfcc-6410d9f993b3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.401030 Jun 15 22:21:19.778094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 380/774] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:19 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:19.826293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:19.829908 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:19.835183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2d89adc1-7b78-4f48-99a3-2ecc22bbbd02 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1680 microversion: 2.1 time: 0.163973 Jun 15 22:21:19.835775 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 395/775] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:19 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:20.339502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-348cb7d3-a088-444b-b321-1bb8b1ed052a req-f4d890c0-eac4-4d4e-a46c-8d8cf1d0f6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8", "name": "network-vif-deleted", "tag": "5349d20e-592a-407e-a1f5-695dbc88a11a"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:20.350508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-348cb7d3-a088-444b-b321-1bb8b1ed052a req-f4d890c0-eac4-4d4e-a46c-8d8cf1d0f6a1 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.351290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-348cb7d3-a088-444b-b321-1bb8b1ed052a req-f4d890c0-eac4-4d4e-a46c-8d8cf1d0f6a1 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.366389 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-348cb7d3-a088-444b-b321-1bb8b1ed052a req-f4d890c0-eac4-4d4e-a46c-8d8cf1d0f6a1 service nova] Creating event network-vif-deleted:5349d20e-592a-407e-a1f5-695dbc88a11a for instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 on hv-cinder-83538 Jun 15 22:21:20.371486 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-348cb7d3-a088-444b-b321-1bb8b1ed052a req-f4d890c0-eac4-4d4e-a46c-8d8cf1d0f6a1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036099 Jun 15 22:21:20.372050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 381/776] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:20.671140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:20.671753 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:20.678875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.679611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.680553 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.681764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.720607 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.721306 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.721962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lazy-loading 'fault' on Instance uuid eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:21:20.766157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be9445fdbc4459da4feb7c0bc1b310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0713040636b4408c95dcadbb9b1fe3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:20.774721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f3df5e35-1b9d-4369-9133-3ee74a59f9f8 tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 200 len: 1312 microversion: 2.1 time: 0.109118 Jun 15 22:21:20.776631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 396/777] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:20 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:20.804609 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:20.805337 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:20.819888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.820751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.821916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.822486 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.852102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:20.853106 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:20.870886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.871431 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:20.872339 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:20.873013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:21.016009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:21.027066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c091635-0097-42be-936d-8488cc42ea20 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 200 len: 1612 microversion: 2.1 time: 0.178731 Jun 15 22:21:21.038848 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 397/778] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:20 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 1612 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:21.041564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:21.049874 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7da743ae-352b-4e9b-b490-8b9a4fc112f3 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1363 microversion: 2.1 time: 0.254756 Jun 15 22:21:21.050915 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 382/779] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:20 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:21.792818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:21.793416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] [instance: eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:21.800466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:21.800908 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:21.801701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:21.802131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:21.816689 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] HTTP exception thrown: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 could not be found. Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Request method failure captured: Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 HTTP/1.1 Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloXw0IITTlRon91G0EAcwBI5qlMcZN5dlWyaYwqJtzGgHBdrhPz3qqV_liwCSOHZLd9uE7nkL7IsTKKAH8sw92b-z7g3YwxQZkRprUFDUrhO0BHGJJg2oDbwR_bPGADhWizwNu-Rl-ymPAWSQlwe0-TJ5UGv0u1fRo4Gk-4AozYWBs Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:21:21.818497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0713040636b4408c95dcadbb9b1fe3cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0713040636b4408c95dcadbb9b1fe3cc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0713040636b4408c95dcadbb9b1fe3cc Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1570137512 Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 9be9445fdbc4459da4feb7c0bc1b310f Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1570137512-project Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 could not be found. Jun 15 22:21:21.819966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8'} Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 could not be found. Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:21.820947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 could not be found. Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 could not be found. Jun 15 22:21:21.822535 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:21.823899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] Returning 404 to user: Instance eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:21.823899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d5562fa4-621b-47e9-bf2b-7219321e85df tempest-ServerRescueNegativeTestJSON-1570137512 tempest-ServerRescueNegativeTestJSON-1570137512-project] 10.222.0.55 "GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8" status: 404 len: 111 microversion: 2.1 time: 0.031718 Jun 15 22:21:21.824360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 398/780] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:21 2022] GET /compute/v2.1/servers/eb5b3f7f-dadb-4a2c-9359-a0c019bdd1a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:22.046085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:22.046642 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:22.053277 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.053767 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.054679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.055114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.059756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:22.070065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:22.070773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:22.074649 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 HTTP/1.1 Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:21:22.076349 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:21:22.077844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '1668ceea-e020-4ddb-9ba0-f7081bb6d557'} Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:22.078630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:21:22.079855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:22.080950 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:22.081031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.081118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4b5aa1f7-a914-4cf3-8a33-33c0d3374df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 404 len: 111 microversion: 2.1 time: 0.035879 Jun 15 22:21:22.081205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.081205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.081205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.082785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 383/781] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:22 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:22.086741 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f80f10d3-08bf-41e4-8e4f-5d62d796425b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '.version_select at 0x7f99db2ef280>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:22.106532 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f80f10d3-08bf-41e4-8e4f-5d62d796425b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106697289" status: 202 len: 0 microversion: 2.1 time: 0.023538 Jun 15 22:21:22.110695 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 384/782] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 15 22:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106697289 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:21:22.215678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:22.223484 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e652072e-fde5-4516-9cb2-1d1fbfcfb36e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1549 microversion: 2.1 time: 0.157868 Jun 15 22:21:22.224208 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 399/783] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:22 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:22.242611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:22.244088 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:22.250397 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.250852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.251625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.252060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.378166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b89c5e39-c92e-4ed5-bdc0-ffa83fae8035 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139944 Jun 15 22:21:22.378730 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 385/784] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:21:22 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:22.392529 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-08eb7566-c4ca-414d-87c1-23eb2d220271 req-84fb19f4-4a2f-45a0-a799-1574aac51a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1668ceea-e020-4ddb-9ba0-f7081bb6d557", "name": "network-vif-deleted", "tag": "7a5309bb-e179-49cf-a40a-bdf42f81c733"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:22.402407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-08eb7566-c4ca-414d-87c1-23eb2d220271 req-84fb19f4-4a2f-45a0-a799-1574aac51a89 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:22.403590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-08eb7566-c4ca-414d-87c1-23eb2d220271 req-84fb19f4-4a2f-45a0-a799-1574aac51a89 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:22.417293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-08eb7566-c4ca-414d-87c1-23eb2d220271 req-84fb19f4-4a2f-45a0-a799-1574aac51a89 service nova] Creating event network-vif-deleted:7a5309bb-e179-49cf-a40a-bdf42f81c733 for instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 on hv-cinder-83538 Jun 15 22:21:22.437806 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-08eb7566-c4ca-414d-87c1-23eb2d220271 req-84fb19f4-4a2f-45a0-a799-1574aac51a89 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049257 Jun 15 22:21:22.438473 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 400/785] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:23.272566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-470fdfa5-6b4b-42ca-bbb2-ec6aa6100df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: .version_select at 0x7f99db2ef040>, body: {"keypair": {"name": "tempest-keypair-1098616949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJK/8zOOjke0dq6ChdY4w6Ic29F+jtmPKgRFJQx2t01mDb7A91mDQ1QWwMjOUIfz2UvhqBMXwxHR9wOrLBVR20Tqk0M47Nfo2Lz1y9xoXsfrckkBXc5GJz8HSNRLI/RMw=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:23.289104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-470fdfa5-6b4b-42ca-bbb2-ec6aa6100df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:21:23.293629 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-470fdfa5-6b4b-42ca-bbb2-ec6aa6100df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:21:23.324471 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-470fdfa5-6b4b-42ca-bbb2-ec6aa6100df8 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056259 Jun 15 22:21:23.325374 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 386/786] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:21:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:23.424095 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-4244d0cf-80c0-4037-8d2c-3bf8bc2fc2a8 req-e1e53438-e8ff-402e-8eba-b2cae5e77ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5613381-5273-4191-a2fb-be14d4a3087c", "tag": "72bdda10-0519-4860-a576-e08996f2fe0f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:23.438601 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4244d0cf-80c0-4037-8d2c-3bf8bc2fc2a8 req-e1e53438-e8ff-402e-8eba-b2cae5e77ce3 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:23.439556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4244d0cf-80c0-4037-8d2c-3bf8bc2fc2a8 req-e1e53438-e8ff-402e-8eba-b2cae5e77ce3 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:23.455225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-4244d0cf-80c0-4037-8d2c-3bf8bc2fc2a8 req-e1e53438-e8ff-402e-8eba-b2cae5e77ce3 service nova] Creating event network-changed:72bdda10-0519-4860-a576-e08996f2fe0f for instance d5613381-5273-4191-a2fb-be14d4a3087c on hv-cinder-83538 Jun 15 22:21:23.462042 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-4244d0cf-80c0-4037-8d2c-3bf8bc2fc2a8 req-e1e53438-e8ff-402e-8eba-b2cae5e77ce3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043325 Jun 15 22:21:23.463554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 401/787] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:25.560998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2030995208", "imageRef": "fd943b18-540b-40fc-b6e1-1246069e04c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51970d37-d292-4c3d-bdb6-727ed5d05edc"}], "security_groups": [{"name": "tempest-securitygroup--1172083547"}], "key_name": "tempest-keypair-1098616949", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:25.670325 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] validate_networks() for [('51970d37-d292-4c3d-bdb6-727ed5d05edc', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:21:26.119517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:21:26.119978 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:21:26.120688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:21:26.121316 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:21:26.124744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:21:26.141981 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:26.142533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:26.143598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:26.144271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:26.166088 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:21:26.177037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Getting quotas for user c10fe54c24554b4db6783014a85cfa72 and project e2dec64625f54967a0032506f799ed6a. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:21:26.190843 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:21:26.194176 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd943b18-540b-40fc-b6e1-1246069e04c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:21:26.273168 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8d09b69d-e615-4aaf-9e9e-d7e7aad42af0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.716416 Jun 15 22:21:26.275175 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 387/788] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:21:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:21:26.289093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6ade8a84-53ca-4ade-9a21-9c8049e7eab5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:26.289934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6ade8a84-53ca-4ade-9a21-9c8049e7eab5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:26.356298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6ade8a84-53ca-4ade-9a21-9c8049e7eab5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:26.366920 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6ade8a84-53ca-4ade-9a21-9c8049e7eab5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1242 microversion: 2.1 time: 0.085280 Jun 15 22:21:26.367844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 402/789] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:26 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:27.384252 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:27.384879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:27.392003 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:27.397593 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:27.398290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:27.399189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:27.399631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:27.568714 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:27.585620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-71f71deb-2c19-4c79-a82c-4f2a945f51c6 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1302 microversion: 2.1 time: 0.204953 Jun 15 22:21:27.597779 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 388/790] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:27 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1302 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:27.983656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-706a3e7f-9792-4193-93b7-cb907d63bfa6 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Action: 'create', calling method: .version_select at 0x7f99db268e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1203806278"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:28.295222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-706a3e7f-9792-4193-93b7-cb907d63bfa6 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.433772 Jun 15 22:21:28.295930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 403/791] 10.222.0.55 () {60 vars in 1154 bytes} [Wed Jun 15 22:21:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 22:21:28.307851 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-863b550f-410a-44f7-8f93-da08f3c346b9 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99dbb0fe50>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:28.360473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-863b550f-410a-44f7-8f93-da08f3c346b9 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 200 len: 345 microversion: 2.1 time: 0.056893 Jun 15 22:21:28.361267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 389/792] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:21:28 2022] GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:28.605764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:28.606374 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:28.614761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:28.615389 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:28.616420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:28.616909 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:28.775430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:28.786066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-18a1774b-6c9a-47a4-9435-b15e43deec68 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.184293 Jun 15 22:21:28.786691 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 404/793] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:28 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:29.373494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4a24179b-5b75-43a8-9538-4ff4b04bd321 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2efc10>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:29.458477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4a24179b-5b75-43a8-9538-4ff4b04bd321 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 200 len: 346 microversion: 2.1 time: 0.089646 Jun 15 22:21:29.459461 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 390/794] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:21:29 2022] GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:29.472678 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ce943d61-4935-4203-b5f9-4b82ba3f9fd8 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Action: 'create', calling method: .version_select at 0x7f99db268820>, body: {"snapshot": {"volume_id": "e55d2f74-ca4d-4c98-b8dc-b4b154414b19", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-279123956"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:29.717700 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ce943d61-4935-4203-b5f9-4b82ba3f9fd8 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.249125 Jun 15 22:21:29.718511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 405/795] 10.222.0.55 () {60 vars in 1161 bytes} [Wed Jun 15 22:21:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:29.737601 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-b6e60e43-8eaa-4bb3-a082-e02226a0ad49 req-8ff53539-2403-4ae3-9e88-3f6107cd4df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdeb888-50e4-4f56-850d-44dab94e033b", "tag": "33de2f64-e8b7-49fe-8d89-1889842798e0"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:29.742335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ddd5636b-07af-47f0-a92f-e8190c716b31 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db237d30>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:29.768184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b6e60e43-8eaa-4bb3-a082-e02226a0ad49 req-8ff53539-2403-4ae3-9e88-3f6107cd4df0 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:29.769038 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b6e60e43-8eaa-4bb3-a082-e02226a0ad49 req-8ff53539-2403-4ae3-9e88-3f6107cd4df0 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:29.786611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-b6e60e43-8eaa-4bb3-a082-e02226a0ad49 req-8ff53539-2403-4ae3-9e88-3f6107cd4df0 service nova] Creating event network-changed:33de2f64-e8b7-49fe-8d89-1889842798e0 for instance cfdeb888-50e4-4f56-850d-44dab94e033b on hv-cinder-83538 Jun 15 22:21:29.792243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ddd5636b-07af-47f0-a92f-e8190c716b31 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 200 len: 286 microversion: 2.1 time: 0.058081 Jun 15 22:21:29.792578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-b6e60e43-8eaa-4bb3-a082-e02226a0ad49 req-8ff53539-2403-4ae3-9e88-3f6107cd4df0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084649 Jun 15 22:21:29.793626 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 406/797] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:29 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:21:29.793765 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 391/797] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:29.808747 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f84a952e-1bac-4609-8e49-36f1275d4da9 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2d7ca0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:29.815501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:29.816796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:29.832400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:29.833179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:29.834799 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:29.835582 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:29.841058 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f84a952e-1bac-4609-8e49-36f1275d4da9 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036458 Jun 15 22:21:29.841732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 392/798] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Jun 15 22:21:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:29.861381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6b5bdaf4-1365-4d69-a556-b84bad948776 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2ef670>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:29.920651 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6b5bdaf4-1365-4d69-a556-b84bad948776 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 200 len: 286 microversion: 2.1 time: 0.067716 Jun 15 22:21:29.921242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 393/799] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:29 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:30.020294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:30.028457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f87d748b-9cf4-49a3-b122-03769feaa684 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.220899 Jun 15 22:21:30.029120 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 407/800] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:29 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:30.933506 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6d395e9f-d85c-408d-8e2a-216d84a0c7bc tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2b1ca0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:30.976576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6d395e9f-d85c-408d-8e2a-216d84a0c7bc tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 200 len: 286 microversion: 2.1 time: 0.048069 Jun 15 22:21:30.977153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 394/801] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:30 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:31.048296 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:31.049163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:31.058644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:31.059203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:31.060272 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:31.060780 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:31.217283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:31.225643 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-79df8d0e-1ff8-409a-8acd-83dd39a50ce9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.182434 Jun 15 22:21:31.226253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 408/802] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:31 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:31.990738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4ee990b9-af3c-45d0-844f-b82328dd8efb tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2ef700>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:32.031258 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4ee990b9-af3c-45d0-844f-b82328dd8efb tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 200 len: 286 microversion: 2.1 time: 0.046155 Jun 15 22:21:32.031832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 395/803] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:31 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:32.243712 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:32.244254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:32.251201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:32.251647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:32.252412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:32.252844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:32.393223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:32.401167 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-77e804d0-7155-4401-8f25-ed2e3456e5f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.161502 Jun 15 22:21:32.401751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 409/804] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:32 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:33.044243 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-27ddd960-96ac-4688-9a4f-bfa84932d710 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2d7ee0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:33.079665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-27ddd960-96ac-4688-9a4f-bfa84932d710 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 200 len: 287 microversion: 2.1 time: 0.039962 Jun 15 22:21:33.080280 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 396/805] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:33 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:33.090875 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-85e7080c-5ef7-4355-bb6f-77ec8b529406 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db24c670>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:33.159863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-85e7080c-5ef7-4355-bb6f-77ec8b529406 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 202 len: 0 microversion: 2.1 time: 0.071346 Jun 15 22:21:33.160806 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 410/806] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Jun 15 22:21:33 2022] DELETE /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:21:33.170215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c4759f36-3484-4570-bc42-1c60c49835f1 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99e1bd0ca0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:33.205280 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c4759f36-3484-4570-bc42-1c60c49835f1 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 200 len: 286 microversion: 2.1 time: 0.038338 Jun 15 22:21:33.205894 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 397/807] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:33 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:21:33.420825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:33.421645 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:33.429344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:33.429805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:33.430640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:33.431070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:33.587971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:33.597178 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ec514c66-8e86-45ac-8468-27c0101979fc tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.181846 Jun 15 22:21:33.597805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 411/808] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:33 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:34.218031 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c1ffcdea-2829-4181-8145-3d633641f92b tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2ef040>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:34.250740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-c1ffcdea-2829-4181-8145-3d633641f92b tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] HTTP exception thrown: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c1ffcdea-2829-4181-8145-3d633641f92b tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Request method failure captured: Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 HTTP/1.1 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqltnbMMdkz4iQpM7Ba17oODkID2qq7WfHsWa48qKH7Qtg2F9dMmArIs5JnzwRlF9t0PshBSr6lmsLJTAjusDWbZR4P6jS5QKvaAq96t0BXqg0aP9iKarQAgmVqaxHPApqQZVhs8csYrmAIuiJZSbIk7xXIpY3awvyJXeQfHookWhB60 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:21:34.254145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ffc7497a4d684bf29448b891b50dc7b8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: e7e028cf9e914cd6b7b3991194339a1e Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '4d35645c-2536-4086-80d5-dfdd8a77a692'} Jun 15 22:21:34.255600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. (HTTP 404) (Request-ID: req-b58cdae5-7506-429e-9712-73166807d517) Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.256502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:21:34.257696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 22:21:34.258830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c1ffcdea-2829-4181-8145-3d633641f92b tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Returning 404 to user: Snapshot 4d35645c-2536-4086-80d5-dfdd8a77a692 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:34.260453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c1ffcdea-2829-4181-8145-3d633641f92b tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692" status: 404 len: 111 microversion: 2.1 time: 0.042197 Jun 15 22:21:34.261534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 398/809] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 15 22:21:34 2022] GET /compute/v2.1/os-snapshots/4d35645c-2536-4086-80d5-dfdd8a77a692 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:34.272347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-09a1998f-d294-4f39-b06a-41d3f3153998 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db3a0670>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:34.341721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-09a1998f-d294-4f39-b06a-41d3f3153998 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 202 len: 0 microversion: 2.1 time: 0.079984 Jun 15 22:21:34.341721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 412/810] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:21:34 2022] DELETE /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:21:34.349556 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aa457f90-8449-4adf-9798-e8544289eb89 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db26df70>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:34.399736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aa457f90-8449-4adf-9798-e8544289eb89 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 200 len: 345 microversion: 2.1 time: 0.053968 Jun 15 22:21:34.400284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 399/811] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:21:34 2022] GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:34.622335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:34.622867 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:34.630887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:34.631431 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:34.632519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:34.633031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:34.780464 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:34.788404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d7755066-60a0-43a6-a352-bbfd32adccbe tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.175476 Jun 15 22:21:34.788984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 413/812] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:34 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:35.413022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6b7fefa-d941-423c-8179-789d4e474531 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db2efe50>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:35.441646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-d6b7fefa-d941-423c-8179-789d4e474531 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] HTTP exception thrown: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6b7fefa-d941-423c-8179-789d4e474531 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Request method failure captured: Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 HTTP/1.1 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqltnbMMdkz4iQpM7Ba17oODkID2qq7WfHsWa48qKH7Qtg2F9dMmArIs5JnzwRlF9t0PshBSr6lmsLJTAjusDWbZR4P6jS5QKvaAq96t0BXqg0aP9iKarQAgmVqaxHPApqQZVhs8csYrmAIuiJZSbIk7xXIpY3awvyJXeQfHookWhB60 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:21:35.443935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ffc7497a4d684bf29448b891b50dc7b8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: e7e028cf9e914cd6b7b3991194339a1e Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'e55d2f74-ca4d-4c98-b8dc-b4b154414b19'} Jun 15 22:21:35.445494 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. (HTTP 404) (Request-ID: req-10fcc61e-a6b6-4f82-971d-962f756f0444) Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.446644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:21:35.448073 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 22:21:35.449491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6b7fefa-d941-423c-8179-789d4e474531 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Returning 404 to user: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d6b7fefa-d941-423c-8179-789d4e474531 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 404 len: 109 microversion: 2.1 time: 0.036775 Jun 15 22:21:35.450825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 400/813] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:21:35 2022] GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:35.460702 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c4df3641-4ae5-498b-87eb-0eee264bbc13 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db27a790>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:35.489488 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-c4df3641-4ae5-498b-87eb-0eee264bbc13 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] HTTP exception thrown: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c4df3641-4ae5-498b-87eb-0eee264bbc13 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Request method failure captured: Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 HTTP/1.1 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqltnbMMdkz4iQpM7Ba17oODkID2qq7WfHsWa48qKH7Qtg2F9dMmArIs5JnzwRlF9t0PshBSr6lmsLJTAjusDWbZR4P6jS5QKvaAq96t0BXqg0aP9iKarQAgmVqaxHPApqQZVhs8csYrmAIuiJZSbIk7xXIpY3awvyJXeQfHookWhB60 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:21:35.491541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ffc7497a4d684bf29448b891b50dc7b8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: e7e028cf9e914cd6b7b3991194339a1e Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'e55d2f74-ca4d-4c98-b8dc-b4b154414b19'} Jun 15 22:21:35.493053 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. (HTTP 404) (Request-ID: req-6f5a4cd1-df02-4182-9f94-5a3c91019de9) Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.493901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 22:21:35.495014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 22:21:35.496285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c4df3641-4ae5-498b-87eb-0eee264bbc13 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Returning 404 to user: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c4df3641-4ae5-498b-87eb-0eee264bbc13 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 404 len: 109 microversion: 2.1 time: 0.036169 Jun 15 22:21:35.497562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 414/814] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:21:35 2022] DELETE /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:35.501878 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-eaf1711e-75b1-4fbc-9fce-a2506f9ddb46 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Calling method '.version_select at 0x7f99db20ab80>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:35.531178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-eaf1711e-75b1-4fbc-9fce-a2506f9ddb46 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] HTTP exception thrown: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-eaf1711e-75b1-4fbc-9fce-a2506f9ddb46 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Request method failure captured: Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 HTTP/1.1 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqltnbMMdkz4iQpM7Ba17oODkID2qq7WfHsWa48qKH7Qtg2F9dMmArIs5JnzwRlF9t0PshBSr6lmsLJTAjusDWbZR4P6jS5QKvaAq96t0BXqg0aP9iKarQAgmVqaxHPApqQZVhs8csYrmAIuiJZSbIk7xXIpY3awvyJXeQfHookWhB60 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:21:35.533169 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ffc7497a4d684bf29448b891b50dc7b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ffc7497a4d684bf29448b891b50dc7b8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: ffc7497a4d684bf29448b891b50dc7b8 Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1081811057 Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: e7e028cf9e914cd6b7b3991194339a1e Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1081811057-project Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'e55d2f74-ca4d-4c98-b8dc-b4b154414b19'} Jun 15 22:21:35.534913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. (HTTP 404) (Request-ID: req-c26a4840-e5ba-4151-aba7-03b3362ff311) Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.535859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 22:21:35.537158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 22:21:35.538487 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-eaf1711e-75b1-4fbc-9fce-a2506f9ddb46 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] Returning 404 to user: Volume e55d2f74-ca4d-4c98-b8dc-b4b154414b19 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-eaf1711e-75b1-4fbc-9fce-a2506f9ddb46 tempest-VolumesSnapshotsTestJSON-1081811057 tempest-VolumesSnapshotsTestJSON-1081811057-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19" status: 404 len: 109 microversion: 2.1 time: 0.036981 Jun 15 22:21:35.539812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 401/815] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 15 22:21:35 2022] GET /compute/v2.1/os-volumes/e55d2f74-ca4d-4c98-b8dc-b4b154414b19 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:21:35.805598 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:35.806930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:35.814367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:35.814809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:35.815576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:35.816006 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:35.952495 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:35.961264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f3efe103-a3fc-4d63-9bc6-3911736937f9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.160050 Jun 15 22:21:35.961910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 415/816] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:35 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:36.976317 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:36.979901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=10 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:36.985600 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:36.986620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:36.998256 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:36.999015 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:37.000306 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:37.001138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:37.161675 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:37.171418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fce676c1-ea5a-4bc5-943d-01b118045f0d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.195764 Jun 15 22:21:37.172215 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 402/817] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:36 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:38.196435 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:38.197260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:38.199048 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:38.205411 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:38.205779 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:38.206556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:38.206987 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:38.361253 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:38.370260 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1f789237-4c8f-4333-b3fc-aa5b1eef712d tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.177777 Jun 15 22:21:38.370933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 416/818] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:38 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:38.886070 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-c17cc786-900f-48ee-839b-f47a2cfcdcf4 req-245232c8-c6ab-48e3-9682-9bd427baf098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdeb888-50e4-4f56-850d-44dab94e033b", "name": "network-vif-plugged", "status": "completed", "tag": "33de2f64-e8b7-49fe-8d89-1889842798e0"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:38.895037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c17cc786-900f-48ee-839b-f47a2cfcdcf4 req-245232c8-c6ab-48e3-9682-9bd427baf098 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:38.895473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c17cc786-900f-48ee-839b-f47a2cfcdcf4 req-245232c8-c6ab-48e3-9682-9bd427baf098 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:38.908502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-c17cc786-900f-48ee-839b-f47a2cfcdcf4 req-245232c8-c6ab-48e3-9682-9bd427baf098 service nova] Creating event network-vif-plugged:33de2f64-e8b7-49fe-8d89-1889842798e0 for instance cfdeb888-50e4-4f56-850d-44dab94e033b on hv-cinder-83538 Jun 15 22:21:38.914825 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-c17cc786-900f-48ee-839b-f47a2cfcdcf4 req-245232c8-c6ab-48e3-9682-9bd427baf098 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268159 Jun 15 22:21:38.915553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 403/819] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:39.391462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:39.392493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:39.395016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:39.400551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:39.400993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:39.401903 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:39.402257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:39.567382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:39.579097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2c31355c-39d1-4c8a-8730-c0e7d2eb5b4b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.192117 Jun 15 22:21:39.579857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 417/820] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:39 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:40.597303 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:40.598006 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:40.605472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:40.605894 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:40.606687 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:40.607146 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:40.772141 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:40.783162 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-30ac24a1-6b6c-43cd-a7d9-12f3426189b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1368 microversion: 2.1 time: 0.189395 Jun 15 22:21:40.783162 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 404/821] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:40 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:41.800335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:41.801029 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:41.808091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:41.808536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:41.809285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:41.809736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:41.950008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:41.958445 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-20b74dd4-6dc8-4524-bd94-afeaa4aa2a39 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1558 microversion: 2.1 time: 0.162594 Jun 15 22:21:41.959066 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 418/822] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:21:41 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:21:41.975485 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:41.976088 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:41.983564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:41.984114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:41.985058 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:41.985582 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:42.073981 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c2953c2d-b030-4484-9b59-32e3b1724c31 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102238 Jun 15 22:21:42.075046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 405/823] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 15 22:21:41 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:43.110731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-5f520168-34b1-4dda-849a-e7565cf65937 req-8dbb2c32-42ae-466e-91e7-3764602f7054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdeb888-50e4-4f56-850d-44dab94e033b", "tag": "33de2f64-e8b7-49fe-8d89-1889842798e0"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:43.120238 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5f520168-34b1-4dda-849a-e7565cf65937 req-8dbb2c32-42ae-466e-91e7-3764602f7054 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:43.120673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5f520168-34b1-4dda-849a-e7565cf65937 req-8dbb2c32-42ae-466e-91e7-3764602f7054 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:43.133191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-5f520168-34b1-4dda-849a-e7565cf65937 req-8dbb2c32-42ae-466e-91e7-3764602f7054 service nova] Creating event network-changed:33de2f64-e8b7-49fe-8d89-1889842798e0 for instance cfdeb888-50e4-4f56-850d-44dab94e033b on hv-cinder-83538 Jun 15 22:21:43.138766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-5f520168-34b1-4dda-849a-e7565cf65937 req-8dbb2c32-42ae-466e-91e7-3764602f7054 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032801 Jun 15 22:21:43.139696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 419/824] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:21:48.289752 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:48.290358 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:48.299662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:48.300235 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:48.301299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:48.301940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:48.331081 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d22a5866-0708-4e75-ab7e-3428067f7f87 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.047967 Jun 15 22:21:48.331647 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 406/825] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Jun 15 22:21:48 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:21:50.771183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:21:50.771812 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:50.779834 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:50.780281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:50.781059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:50.781543 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:50.784151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=89 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:50.808532 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lazy-loading 'flavor' on Instance uuid 68873eb8-8080-4f9a-ab71-0335149287b4 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:21:51.092860 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d5eb564a-8e6e-4257-a54e-3cbfd9f6a1d3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/action" status: 202 len: 0 microversion: 2.20 time: 0.326337 Jun 15 22:21:51.093578 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 420/826] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 15 22:21:50 2022] POST /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:21:51.103431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:51.104033 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:51.111410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:51.111986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:51.112757 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:51.113233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:51.254763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:51.263842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:51.265409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:51.266551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-138059fe-e90b-4abb-8bbb-8412ea962c0e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.167086 Jun 15 22:21:51.267432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 407/827] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:51 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:52.287570 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:52.288294 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:52.295335 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:52.295971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:52.296816 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:52.297251 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:52.434182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:52.442638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:52.444150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:52.445320 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e58504d9-63c4-4e68-89cd-fe5735687ffa tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.162979 Jun 15 22:21:52.445910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 421/828] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:52 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:53.464300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:53.465071 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:53.473489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:53.473952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:53.474740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:53.475178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:53.479752 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=43 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:53.629832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:53.639670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:53.641364 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:53.642666 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a08a94d-37d3-4721-9b20-597b8e7f950b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.182510 Jun 15 22:21:53.643330 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 408/829] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:53 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:54.662322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:54.663130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:54.674382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:54.674796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:54.675795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:54.676424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:54.819957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:54.828673 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:54.830201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:54.831379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-99924cc9-29a4-4a2d-8778-a849b1ec2bf3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.173371 Jun 15 22:21:54.831939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 422/830] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:54 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:55.850677 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:55.851360 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:55.858027 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:55.858476 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:55.859237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:55.859670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:56.000048 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:56.008873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:56.010394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:56.011561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-228c547d-3f42-4e72-a555-531c53943edc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.164941 Jun 15 22:21:56.012123 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 409/831] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:55 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:57.033649 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:57.034490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:57.045405 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:57.046026 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:57.047238 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:57.047900 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:57.204122 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:57.212819 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:57.214344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:57.215501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0727016b-0e20-47e7-b8ff-c52ff209e183 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.188396 Jun 15 22:21:57.216062 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 423/832] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:57 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:21:58.236655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:58.237276 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:58.240221 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=19 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:58.246238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:58.246684 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:58.247465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:58.247949 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:58.386410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:58.394797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:58.396479 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:58.397846 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ec7998b5-e5c4-487d-b755-eef296db6fc6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.165185 Jun 15 22:21:58.398418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 410/833] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:58 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:59.416638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:59.417380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:59.424208 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:59.424656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:59.425455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:59.425893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:59.592723 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:59.604186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:59.605808 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:21:59.607222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a53da9d3-7524-43d6-bad8-92097c50b6d5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.194716 Jun 15 22:21:59.608201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 424/834] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:21:59 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:21:59.665578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:21:59.666140 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:21:59.673932 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:59.674473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:59.675290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:21:59.675991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:21:59.706567 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ca27cea6-35b8-4f61-a88b-b3812f4fcf8d tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/ips" status: 200 len: 145 microversion: 2.1 time: 0.045089 Jun 15 22:21:59.707143 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 411/835] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:21:59 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:00.626355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:00.626938 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:00.634229 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:00.635254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:00.636028 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:00.636458 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:00.786096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:00.794753 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:00.796268 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:00.797500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9e14e642-53d7-4ea5-8044-dbd99150c85c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.175241 Jun 15 22:22:00.798061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 425/836] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:00 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:01.065203 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a745f6f-fdb8-4e84-bf75-bcbe34dfb860"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:01.066360 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:01.074507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:01.074963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:01.075747 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:01.076178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:01.380122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bd4b3f14-515d-4e88-8a14-84694c2e7227 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318604 Jun 15 22:22:01.380763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 412/837] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:22:01 2022] POST /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:01.816279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:01.816853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:01.823437 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:01.823877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:01.824638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:01.825168 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:01.978905 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:01.987415 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:01.989023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:01.990315 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a935c635-37e0-468a-9f68-09f04ec37cd7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.178189 Jun 15 22:22:01.995726 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 426/838] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:01 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:03.012429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:03.013155 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:03.024743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:03.025272 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:03.026144 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:03.026579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:03.184149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:03.192936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:03.194596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:03.195756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-06b6490e-00c2-4aef-a2a0-c9210f75215d tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.188029 Jun 15 22:22:03.196336 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 413/839] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:03 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:04.217423 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:04.218064 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:04.225594 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:04.226022 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:04.226821 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:04.227264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:04.373163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:04.381836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:04.383334 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:04.384492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2a382fca-9e55-4fd8-bb4f-76e784962aad tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.171249 Jun 15 22:22:04.385772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 427/840] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:04 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:05.404135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:05.404713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:05.413454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:05.414246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:05.415557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:05.415991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:05.562380 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:05.571414 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:05.572986 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:05.574087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7e2a1ea5-5562-4986-9142-4679c9858415 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.174435 Jun 15 22:22:05.574728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 414/841] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:05 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:06.596180 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:06.597000 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:06.604352 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:06.604953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:06.605768 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:06.606204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:06.751595 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:06.759918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:06.761426 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:06.762589 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-abf92d18-418d-448e-879a-e73ddb79d2e3 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.170799 Jun 15 22:22:06.763152 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 428/842] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:06 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:07.781534 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:07.782173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:07.788908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:07.789406 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:07.790141 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:07.790577 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:07.929768 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:07.938631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:07.940154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:07.941308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3b0c4706-df31-4ec8-92f6-03de8706a853 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.164383 Jun 15 22:22:07.942100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 415/843] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:07 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:08.931449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:08.932475 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:08.939464 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:08.939915 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:08.940679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:08.941117 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:08.960384 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:08.961001 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:08.968402 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:08.968864 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:08.969742 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:08.970157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:08.971068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0bc9a141-1936-4140-924c-4a5edf4a3e30 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Jun 15 22:22:08.971644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 429/844] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:08 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:08.981308 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:08.981824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:08.987906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:08.988359 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:08.989135 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:08.989602 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:09.019883 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-752cc3e5-c317-4987-acff-ce570916efed tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/6a745f6f-fdb8-4e84-bf75-bcbe34dfb860" status: 200 len: 194 microversion: 2.1 time: 0.042142 Jun 15 22:22:09.020388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 430/845] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 15 22:22:08 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/6a745f6f-fdb8-4e84-bf75-bcbe34dfb860 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:22:09.108887 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:09.117482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:09.118998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:09.120168 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-137c8ab2-4699-4be3-a55d-854fa9204f25 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.163893 Jun 15 22:22:09.120740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 416/846] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:08 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:10.140909 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:10.141532 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:10.143967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=28 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:10.149637 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:10.150072 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:10.150823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:10.151245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:10.297519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:10.305573 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:10.307143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:10.308313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e6972930-0c45-4ae7-bf46-46c6c7a381a0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.172084 Jun 15 22:22:10.309033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 431/847] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:10 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:10.381568 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67362bb5-967f-4762-b8b3-0c1fcccb10c1"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:10.382663 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:10.389301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:10.389779 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:10.390537 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:10.391033 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:10.675871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-feb9ba0d-8c69-4fb3-8042-048ce6d43159 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "POST /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298198 Jun 15 22:22:10.676507 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 417/848] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:22:10 2022] POST /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:11.327836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:11.328711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:11.335559 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:11.336049 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:11.336917 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:11.337527 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:11.495251 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:11.503925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:11.505543 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:11.506706 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-64d289e0-8130-4364-be5a-5323066993a4 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.183703 Jun 15 22:22:11.507417 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 432/849] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:11 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:12.529627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:12.530263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:12.538608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:12.539059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:12.539840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:12.540283 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:12.675638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:12.683858 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:12.685316 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:12.686496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d11f9c58-85c8-428a-9562-94ced8b01572 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1745 microversion: 2.20 time: 0.163285 Jun 15 22:22:12.687237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 418/850] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:12 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:13.706200 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:13.706825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:13.713628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:13.714082 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:13.714846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:13.715290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:13.860933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:13.868995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:13.870522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:13.871813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1252b459-762b-417f-adc4-ac71b747332b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1745 microversion: 2.20 time: 0.169821 Jun 15 22:22:13.872352 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 433/851] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:13 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:14.860055 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-8d29838b-e4ff-4d1c-ac7a-50ec34d0ee10 req-18793b70-3226-4f97-81f6-139061f4fb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "name": "network-vif-plugged", "status": "completed", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:14.870638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8d29838b-e4ff-4d1c-ac7a-50ec34d0ee10 req-18793b70-3226-4f97-81f6-139061f4fb02 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:14.871045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8d29838b-e4ff-4d1c-ac7a-50ec34d0ee10 req-18793b70-3226-4f97-81f6-139061f4fb02 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:14.890037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-8d29838b-e4ff-4d1c-ac7a-50ec34d0ee10 req-18793b70-3226-4f97-81f6-139061f4fb02 service nova] Creating event network-vif-plugged:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:22:14.890240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:14.890775 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:14.897628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:14.898401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:14.899368 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:14.900007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:14.903496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-8d29838b-e4ff-4d1c-ac7a-50ec34d0ee10 req-18793b70-3226-4f97-81f6-139061f4fb02 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044443 Jun 15 22:22:14.905009 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 419/852] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:22:15.055148 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:15.059708 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:15.067373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:15.069307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:15.071626 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7543b296-4da6-4280-ae4b-bee4ddca6d42 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.185430 Jun 15 22:22:15.073715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 434/853] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:14 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:16.093368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:16.094031 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:16.101931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:16.102591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:16.104210 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:16.104806 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:16.270736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:16.280407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:16.282099 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:16.283246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6c4badb8-067c-459f-ba6c-6edab229a07a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.194535 Jun 15 22:22:16.286034 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 420/854] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:16 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:17.689116 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:17.690379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:17.701472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:17.703426 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:17.704633 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:17.705434 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:17.966269 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:17.975761 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:17.977615 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:17.978783 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c741f872-85a1-497f-9635-4799bb9308f9 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.679482 Jun 15 22:22:17.979395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 435/855] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:17 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:18.319013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:18.321391 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:18.331418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:18.331874 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:18.332653 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:18.333082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:18.373140 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f3c62fde-4783-4d0f-a6cd-53ce8c49b755 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058417 Jun 15 22:22:18.374389 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 421/856] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:18 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:18.531999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:18.532688 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:18.550889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:18.551676 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:18.553445 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:18.563105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:18.614856 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c420229e-d793-4957-a858-4ea0027ab7e9 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/6a745f6f-fdb8-4e84-bf75-bcbe34dfb860" status: 200 len: 194 microversion: 2.1 time: 0.087554 Jun 15 22:22:18.616722 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 436/857] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 15 22:22:18 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/6a745f6f-fdb8-4e84-bf75-bcbe34dfb860 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:18.627796 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:18.628202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:18.634930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:18.635368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:18.636142 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:18.636837 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:18.739246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lazy-loading 'services' on Instance uuid d5613381-5273-4191-a2fb-be14d4a3087c {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:22:18.754109 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:18.867663 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c050dcb-26d6-43cc-94f6-f11b2a17c8e7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/6a745f6f-fdb8-4e84-bf75-bcbe34dfb860" status: 202 len: 0 microversion: 2.1 time: 0.240780 Jun 15 22:22:18.868393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 422/858] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:22:18 2022] DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/6a745f6f-fdb8-4e84-bf75-bcbe34dfb860 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:22:18.996570 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:18.997509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:19.024775 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:19.035455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:19.036512 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:19.038308 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:19.328696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:19.346597 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:19.357061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:19.361783 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-523350fe-4319-4e03-bced-8bc6f350a577 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.368332 Jun 15 22:22:19.365831 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 437/859] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:18 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:20.389662 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:20.391201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:20.403763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:20.404440 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:20.405428 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:20.406022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:20.607633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:20.630248 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:20.631743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:20.632936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fd03bac3-e81c-4101-89ef-fb546d800166 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.255579 Jun 15 22:22:20.637432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 423/860] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:20 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:21.053836 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:21.054935 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:21.067954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.068404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.072774 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.073582 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.111339 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-345058d5-ce28-43ed-a891-3cfc8fa9b0f5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/ips" status: 200 len: 150 microversion: 2.1 time: 0.061865 Jun 15 22:22:21.112519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 438/861] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 15 22:22:21 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:21.187951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:21.188871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:21.201952 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.205373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.206470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.207147 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.274424 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-acdf8190-5dd2-439e-af59-958440ff298e tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/67362bb5-967f-4762-b8b3-0c1fcccb10c1" status: 200 len: 194 microversion: 2.1 time: 0.090878 Jun 15 22:22:21.275453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 424/862] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 15 22:22:21 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/67362bb5-967f-4762-b8b3-0c1fcccb10c1 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:21.287093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:21.291696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:21.304113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.305919 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.307407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.308185 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.465103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lazy-loading 'services' on Instance uuid d5613381-5273-4191-a2fb-be14d4a3087c {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:22:21.651250 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:21.651936 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:21.684887 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-84441f73-a733-4706-8aa8-5c8a1b93afcd tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/67362bb5-967f-4762-b8b3-0c1fcccb10c1" status: 202 len: 0 microversion: 2.1 time: 0.403230 Jun 15 22:22:21.688020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 439/863] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:22:21 2022] DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments/67362bb5-967f-4762-b8b3-0c1fcccb10c1 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:22:21.688956 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.689737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.710722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:21.714201 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:21.989617 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:22.004416 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:22.006026 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:22.007301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-783056ff-71e1-4211-af15-3bcd1cfa0bfc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.360284 Jun 15 22:22:22.017738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 425/864] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:21 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:22.793367 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22c06879-a3bd-4854-93e1-ca49f22eabcb"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:22.796233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:22.805711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:22.807023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:22.808939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:22.809694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.027697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:23.029656 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:23.073840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.076173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.080726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.081412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.301623 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:23.318726 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:23.320827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:23.322254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7716d66a-4797-4edc-ab52-469a36b69712 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.300735 Jun 15 22:22:23.323300 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 426/865] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:23 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:23.325077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7389a370-1049-412c-8418-cb5409b61e90 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "POST /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530952 Jun 15 22:22:23.325980 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 440/866] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:22:22 2022] POST /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:23.338499 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:23.339657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:23.351833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.352288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.353103 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.353569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.426291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6db61f8e-18cf-47bc-8ad1-f2bd4eb80568 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101583 Jun 15 22:22:23.432542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 427/867] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:23 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:22:23.657750 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:23.659214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:23.666794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.668002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.669002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.669658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.711244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7045d2b1-7914-4875-8e6f-eca7c7bc12b6 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060612 Jun 15 22:22:23.712925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 441/868] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:23 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:22:23.804783 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:23.805085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:23.814304 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.814757 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.815538 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:23.815970 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:23.851453 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:22:23.983521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-370c04c5-d030-4a82-a010-11ca5493bdc0 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 204 len: 0 microversion: 2.1 time: 0.183398 Jun 15 22:22:23.984955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 428/869] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:23 2022] DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:22:23.993131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:23.993946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:24.012741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:24.013191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:24.017381 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:24.017804 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:24.288370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:24.300915 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-712dba20-e890-4cd0-8e02-c3f4481f97db tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1673 microversion: 2.1 time: 0.311653 Jun 15 22:22:24.301772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 442/870] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:23 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:24.355267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:24.357713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:24.371247 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:24.372353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:24.374165 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:24.374800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:24.596052 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:24.605738 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:24.607758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:24.608978 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9e994007-482b-436f-b45a-64b27c14479e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.267891 Jun 15 22:22:24.619314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 429/871] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:24 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:25.319376 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:25.319986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:25.335710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:25.336163 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:25.336958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:25.337449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:25.592871 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:25.603508 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f9210efb-f245-49e0-9330-8a76f9d77004 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1673 microversion: 2.1 time: 0.288220 Jun 15 22:22:25.620522 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 443/872] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:25 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1673 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:25.628949 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:25.629592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:25.643005 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:25.643458 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:25.644238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:25.644672 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:26.042362 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:26.067859 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:26.071429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:26.077149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b02a7f0a-6b51-4eb2-aa50-8fbf9409f528 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.452235 Jun 15 22:22:26.082570 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 430/873] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:25 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:26.621507 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:26.622214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:26.640517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:26.641880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:26.642861 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:26.643953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:26.881574 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:26.927131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a497ef99-8316-425f-b877-021512953835 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1673 microversion: 2.1 time: 0.288147 Jun 15 22:22:26.932545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 444/874] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:26 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1673 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:27.098827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:27.099424 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:27.110753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:27.121478 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:27.122649 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:27.123279 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:27.535780 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:27.548308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:27.555414 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:27.557116 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-973b67fc-3530-4ba5-a9e1-a20affa695c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 0.462463 Jun 15 22:22:27.562138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 431/875] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:27 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:27.948273 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:27.948946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:27.958743 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:27.959186 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:27.959956 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:27.965245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:28.098176 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:28.110532 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-63e45f66-b814-4547-b2d8-42e4f466f56f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1605 microversion: 2.1 time: 0.165970 Jun 15 22:22:28.116057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 445/876] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:27 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1605 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:28.581198 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:28.583851 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:28.588931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:28.602661 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:28.603115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:28.608041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:28.608651 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:29.159808 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:29.160484 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:29.175912 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:29.176359 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:29.180168 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:29.180624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:29.346579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f1fbe76564467b378035d0d2d3be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c37e59766f45c3a46489befb803ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:29.354511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-47a8c29d-d8b3-49fd-a2b1-f307a71f3338 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 200 len: 1605 microversion: 2.1 time: 0.229658 Jun 15 22:22:29.355121 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 446/877] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:29 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:29.497444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-c5133cc8-3cc4-49d5-909f-cd4cfb4396c8 req-a965a3ea-591c-436b-bb56-71a6c34c08e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5613381-5273-4191-a2fb-be14d4a3087c", "name": "network-vif-deleted", "tag": "72bdda10-0519-4860-a576-e08996f2fe0f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:29.519174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c5133cc8-3cc4-49d5-909f-cd4cfb4396c8 req-a965a3ea-591c-436b-bb56-71a6c34c08e8 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:29.521600 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c5133cc8-3cc4-49d5-909f-cd4cfb4396c8 req-a965a3ea-591c-436b-bb56-71a6c34c08e8 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:29.555668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-c5133cc8-3cc4-49d5-909f-cd4cfb4396c8 req-a965a3ea-591c-436b-bb56-71a6c34c08e8 service nova] Creating event network-vif-deleted:72bdda10-0519-4860-a576-e08996f2fe0f for instance d5613381-5273-4191-a2fb-be14d4a3087c on hv-cinder-83538 Jun 15 22:22:29.570426 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-c5133cc8-3cc4-49d5-909f-cd4cfb4396c8 req-a965a3ea-591c-436b-bb56-71a6c34c08e8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077796 Jun 15 22:22:29.574128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 447/878] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:22:29.651440 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:29.664085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:29.670475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:29.672063 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0de979f0-2c2a-4c64-aaa7-9dcc3676211a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1740 microversion: 2.20 time: 1.095606 Jun 15 22:22:29.673808 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 432/879] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:28 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1740 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:30.373876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:30.374651 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:30.387957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:30.389249 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:30.391494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:30.393304 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:30.431277 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] HTTP exception thrown: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Request method failure captured: Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c HTTP/1.1 Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloMtjSEDjj4wyTlX3Vkg8aHVJhtdyjQi-dJy8lQrVuv8QMZX-Lhi5hdf_2Xv4skwW5gOVcWFN0qOlezjpGV0a5Ojd5u8lNcW_R2DzQMWnZOVZppzh6VDcQp_hDnEEt55NB5d6Hbfp9L_B76DvWcStN91eRCBvnxXNLCBbVJ_JwTQBE Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:22:30.435721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1c37e59766f45c3a46489befb803ff3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 728f1fbe76564467b378035d0d2d3be5 Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:30.437585 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'd5613381-5273-4191-a2fb-be14d4a3087c'} Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:30.438390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:30.439930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:30.442270 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Returning 404 to user: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:30.444085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aef763fe-5477-4348-a107-e0e26755d53a tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 404 len: 111 microversion: 2.1 time: 0.075168 Jun 15 22:22:30.445220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 448/880] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:30 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:30.454900 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-da6505bb-ecb4-4232-b4b3-26c2a1d263f7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '.version_select at 0x7f99db221280>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:30.491879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-da6505bb-ecb4-4232-b4b3-26c2a1d263f7 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476603479" status: 202 len: 0 microversion: 2.1 time: 0.040813 Jun 15 22:22:30.494190 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 433/881] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 15 22:22:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476603479 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:22:30.692029 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:30.692641 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:30.705496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:30.706049 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:30.707237 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:30.707978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:31.001638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:31.028563 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:31.036650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:31.039065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3cfe7ce1-e2be-43e3-8a42-aa7647dfe661 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1722 microversion: 2.20 time: 0.351766 Jun 15 22:22:31.042139 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 449/882] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:30 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:32.066914 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:32.067512 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:32.082805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.083771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.084796 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.085422 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.293968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:32.306106 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:32.307665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:32.310068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-72ca3f11-9fbe-4528-b14a-b371247fa5c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1722 microversion: 2.20 time: 0.248882 Jun 15 22:22:32.313713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 434/883] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:32 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:32.572398 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:32.573619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:32.581344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.581767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.582776 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.583197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.699252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lazy-loading 'services' on Instance uuid cfdeb888-50e4-4f56-850d-44dab94e033b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:22:32.702665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:32.806527 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d6976f33-54e5-410e-9bc4-c961825e86eb tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments/22c06879-a3bd-4854-93e1-ca49f22eabcb" status: 202 len: 0 microversion: 2.1 time: 0.237629 Jun 15 22:22:32.807739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 450/884] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:22:32 2022] DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments/22c06879-a3bd-4854-93e1-ca49f22eabcb => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:22:32.818429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:32.819787 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:32.835298 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.836044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.836989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.837657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.884216 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d3809269-e43d-4d68-8eed-7262b795341a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070151 Jun 15 22:22:32.884993 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 435/885] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:32 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:32.922113 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-7d5d2a41-e807-4192-a575-ed6187a1e831 req-c45d4f2c-3f67-4fd9-b679-b9e8713a655f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:32.940051 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7d5d2a41-e807-4192-a575-ed6187a1e831 req-c45d4f2c-3f67-4fd9-b679-b9e8713a655f service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:32.940562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7d5d2a41-e807-4192-a575-ed6187a1e831 req-c45d4f2c-3f67-4fd9-b679-b9e8713a655f service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:32.957094 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-7d5d2a41-e807-4192-a575-ed6187a1e831 req-c45d4f2c-3f67-4fd9-b679-b9e8713a655f service nova] Creating event network-vif-unplugged:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:22:32.967050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-7d5d2a41-e807-4192-a575-ed6187a1e831 req-c45d4f2c-3f67-4fd9-b679-b9e8713a655f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050737 Jun 15 22:22:32.968285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 451/886] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:33.297681 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-039b52b3-d9ff-465a-8266-5b8f38b5b59e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Action: 'create', calling method: .version_select at 0x7f99db21b670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2118278866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKggRG+4XU+IhmXocG832j8trYoaurc2CztoduSC0AG3L+nR21OaGRUXcpcs55BeQSz33D0oVY1daLSF4j51wIyBkSdovtCU1XKaTc9l579kAPRbAnEbx2retAGzqnx7DQ=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:33.313549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-039b52b3-d9ff-465a-8266-5b8f38b5b59e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Getting quotas for project 1bc7b00884114a089c6d2c785fc8e9ed. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:22:33.317603 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-039b52b3-d9ff-465a-8266-5b8f38b5b59e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Getting quotas for user fb2ceaafe83f4d67ae9ea6492b21a850 and project 1bc7b00884114a089c6d2c785fc8e9ed. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:22:33.330495 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:33.331524 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:33.338518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:33.338969 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:33.339751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:33.340230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:33.342076 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-039b52b3-d9ff-465a-8266-5b8f38b5b59e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.229005 Jun 15 22:22:33.343002 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 436/887] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:22:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:33.563608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:33.582021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:33.583773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:33.584998 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0d95ff00-4c96-44b1-a8ff-0df788a170d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1722 microversion: 2.20 time: 0.259132 Jun 15 22:22:33.591493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 452/888] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:33 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:33.897896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:33.901813 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:33.922125 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:33.922946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:33.924607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:33.925693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:33.979875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ccb981cb-c3b8-4821-bac7-c827c3f827ae tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087145 Jun 15 22:22:33.980736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 437/889] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:33 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:34.610095 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:34.611636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:34.620919 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:34.622102 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:34.623316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:34.623773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:34.664312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:34.666023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:34.677644 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:34.678098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:34.678942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:34.680963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:34.708966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] HTTP exception thrown: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Request method failure captured: Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c HTTP/1.1 Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloMtjSEDjj4wyTlX3Vkg8aHVJhtdyjQi-dJy8lQrVuv8QMZX-Lhi5hdf_2Xv4skwW5gOVcWFN0qOlezjpGV0a5Ojd5u8lNcW_R2DzQMWnZOVZppzh6VDcQp_hDnEEt55NB5d6Hbfp9L_B76DvWcStN91eRCBvnxXNLCBbVJ_JwTQBE Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:34.711225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1c37e59766f45c3a46489befb803ff3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 728f1fbe76564467b378035d0d2d3be5 Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.712620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'd5613381-5273-4191-a2fb-be14d4a3087c'} Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:34.713381 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.714586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.718091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Returning 404 to user: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:34.719477 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-11d23c06-8d3c-48f0-97a1-6fd57aba0ca2 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 404 len: 111 microversion: 2.1 time: 0.060334 Jun 15 22:22:34.720906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 438/890] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:34 2022] DELETE /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:34.742071 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:34.743341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: d5613381-5273-4191-a2fb-be14d4a3087c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:34.757141 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:34.758048 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:34.759664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:34.760846 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:34.793705 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] HTTP exception thrown: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Request method failure captured: Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c HTTP/1.1 Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloMtjSEDjj4wyTlX3Vkg8aHVJhtdyjQi-dJy8lQrVuv8QMZX-Lhi5hdf_2Xv4skwW5gOVcWFN0qOlezjpGV0a5Ojd5u8lNcW_R2DzQMWnZOVZppzh6VDcQp_hDnEEt55NB5d6Hbfp9L_B76DvWcStN91eRCBvnxXNLCBbVJ_JwTQBE Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:34.797224 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1c37e59766f45c3a46489befb803ff3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 728f1fbe76564467b378035d0d2d3be5 Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.798910 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'd5613381-5273-4191-a2fb-be14d4a3087c'} Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:34.799785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. Jun 15 22:22:34.801447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:34.802702 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Returning 404 to user: Instance d5613381-5273-4191-a2fb-be14d4a3087c could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:34.808242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-30c4b0f5-5719-4f8d-9160-6f043fc557a4 tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c" status: 404 len: 111 microversion: 2.1 time: 0.073902 Jun 15 22:22:34.811500 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 439/891] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:34 2022] GET /compute/v2.1/servers/d5613381-5273-4191-a2fb-be14d4a3087c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:34.922613 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:34.940264 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:34.942448 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:34.944036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6d6a3031-f9e3-4dbd-b9ff-b40ccb9993d6 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1665 microversion: 2.20 time: 0.339282 Jun 15 22:22:34.957373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 453/892] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:34 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1665 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:34.973943 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0e58a02-c874-40a3-a320-f2c2bed0747d"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:34.975188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:35.000837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:35.002905 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:35.010181 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.010979 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.012444 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.015853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.018330 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.020878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.022024 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.029064 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.085794 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3000a837-4904-46d6-916a-ef84e1da943a tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095480 Jun 15 22:22:35.087925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 454/893] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:22:34 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:22:35.268654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:35.269916 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:35.284870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.285724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.293197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.294203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.336849 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:22:35.338212 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:35.528407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e26974e8-9cef-414f-9c04-5e4b897db8e9 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 204 len: 0 microversion: 2.1 time: 0.275767 Jun 15 22:22:35.529031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 455/894] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:35 2022] DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:22:35.553515 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:35.554795 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:35.584075 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.585313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.586455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:35.587166 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:35.910154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-20dfb80f-f493-458b-a786-5e3b24b7bc12 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.929173 Jun 15 22:22:35.936267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 440/895] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Jun 15 22:22:34 2022] POST /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-volume_attachments => generated 188 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 22:22:35.960560 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:35.987613 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d44d5611-08f9-402c-9383-2780b9a35cde tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1683 microversion: 2.1 time: 0.447823 Jun 15 22:22:35.989391 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 456/896] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:35 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1683 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:22:36.018313 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:36.019448 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:36.029309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.029939 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.030841 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.031579 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.053576 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] HTTP exception thrown: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Request method failure captured: Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 HTTP/1.1 Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloMtjSEDjj4wyTlX3Vkg8aHVJhtdyjQi-dJy8lQrVuv8QMZX-Lhi5hdf_2Xv4skwW5gOVcWFN0qOlezjpGV0a5Ojd5u8lNcW_R2DzQMWnZOVZppzh6VDcQp_hDnEEt55NB5d6Hbfp9L_B76DvWcStN91eRCBvnxXNLCBbVJ_JwTQBE Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:36.055835 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1c37e59766f45c3a46489befb803ff3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 728f1fbe76564467b378035d0d2d3be5 Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.057523 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'b6aaf51e-4c52-4369-93d6-cab9d1aa1322'} Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:36.058497 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.060050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.061638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Returning 404 to user: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:36.061638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fa31b655-77fb-4b62-8162-ca22377e632f tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 404 len: 111 microversion: 2.1 time: 0.045648 Jun 15 22:22:36.061638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 441/897] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:36 2022] DELETE /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 22:22:36.070756 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:36.071438 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] [instance: b6aaf51e-4c52-4369-93d6-cab9d1aa1322] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:36.081285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.081784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.083493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.084586 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.101881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:36.102370 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:36.103494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] HTTP exception thrown: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Request method failure captured: Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 HTTP/1.1 Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloMtjSEDjj4wyTlX3Vkg8aHVJhtdyjQi-dJy8lQrVuv8QMZX-Lhi5hdf_2Xv4skwW5gOVcWFN0qOlezjpGV0a5Ojd5u8lNcW_R2DzQMWnZOVZppzh6VDcQp_hDnEEt55NB5d6Hbfp9L_B76DvWcStN91eRCBvnxXNLCBbVJ_JwTQBE Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:22:36.105413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1c37e59766f45c3a46489befb803ff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1c37e59766f45c3a46489befb803ff3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e1c37e59766f45c3a46489befb803ff3 Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1093817820 Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 728f1fbe76564467b378035d0d2d3be5 Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-1093817820-project Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.107003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'b6aaf51e-4c52-4369-93d6-cab9d1aa1322'} Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:36.107868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. Jun 15 22:22:36.109517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:36.111852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.111852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.112128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] Returning 404 to user: Instance b6aaf51e-4c52-4369-93d6-cab9d1aa1322 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:36.112616 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.112930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-721a00a2-8265-4a3a-bb49-1a1162d2a73c tempest-AttachVolumeTestJSON-1093817820 tempest-AttachVolumeTestJSON-1093817820-project] 10.222.0.55 "GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322" status: 404 len: 111 microversion: 2.1 time: 0.049538 Jun 15 22:22:36.113403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.113910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 457/898] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:36 2022] GET /compute/v2.1/servers/b6aaf51e-4c52-4369-93d6-cab9d1aa1322 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:36.499492 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-159241e4-8212-4a6d-90e7-bb3109e55f0c tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-volume_attachments/d0e58a02-c874-40a3-a320-f2c2bed0747d" status: 202 len: 0 microversion: 2.20 time: 0.400284 Jun 15 22:22:36.501749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 442/899] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Jun 15 22:22:36 2022] DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-volume_attachments/d0e58a02-c874-40a3-a320-f2c2bed0747d => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 22:22:36.583546 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:36.584008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:36.590626 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.591070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.591864 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.592303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.710065 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4b94bcca-1376-4353-acf4-062bd59f54a8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "POST /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/action" status: 202 len: 0 microversion: 2.20 time: 0.130728 Jun 15 22:22:36.710693 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 458/900] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 15 22:22:36 2022] POST /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:22:36.721906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:36.722536 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:36.730384 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.732223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:36.733294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:36.734039 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:37.009420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:37.010054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:37.023430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:37.023880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:37.024665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:37.025096 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:37.155389 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:37.198909 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:37.202663 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:37.207681 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-53c5042a-2728-49ef-a6b3-396348632b63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1673 microversion: 2.20 time: 0.488529 Jun 15 22:22:37.219174 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 443/901] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:36 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1673 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:37.292364 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:37.312974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9562af21-f31e-4854-aca3-e518b7c59036 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1683 microversion: 2.1 time: 0.309763 Jun 15 22:22:37.313799 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 459/902] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:37 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1683 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:38.227101 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:38.229013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:38.246650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:38.247162 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:38.248173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:38.248918 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:38.333493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:38.334624 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:38.356933 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:38.357682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:38.358660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:38.359124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:38.436523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:38.447398 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-66650198-d093-48a7-96e9-60d481a64819 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1615 microversion: 2.1 time: 0.120965 Jun 15 22:22:38.457427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 460/903] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:38 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1615 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:38.616771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:38.626660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:38.628158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:38.629436 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-00ce1597-c50d-4bbd-90f5-e674d21fd1c2 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1675 microversion: 2.20 time: 0.406808 Jun 15 22:22:38.629935 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 444/904] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:38 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1675 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:39.307518 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-99d89e81-1429-43dd-97b5-70f93121dd6f req-2ce023ab-8092-4ee8-a741-69c153cd7d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdeb888-50e4-4f56-850d-44dab94e033b", "name": "network-vif-deleted", "tag": "33de2f64-e8b7-49fe-8d89-1889842798e0"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:39.327689 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-99d89e81-1429-43dd-97b5-70f93121dd6f req-2ce023ab-8092-4ee8-a741-69c153cd7d5e service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:39.328390 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-99d89e81-1429-43dd-97b5-70f93121dd6f req-2ce023ab-8092-4ee8-a741-69c153cd7d5e service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:39.363293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-99d89e81-1429-43dd-97b5-70f93121dd6f req-2ce023ab-8092-4ee8-a741-69c153cd7d5e service nova] Creating event network-vif-deleted:33de2f64-e8b7-49fe-8d89-1889842798e0 for instance cfdeb888-50e4-4f56-850d-44dab94e033b on hv-cinder-83538 Jun 15 22:22:39.373648 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-99d89e81-1429-43dd-97b5-70f93121dd6f req-2ce023ab-8092-4ee8-a741-69c153cd7d5e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071550 Jun 15 22:22:39.375386 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 461/905] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:39.466087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:39.469007 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:39.498632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:39.499395 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:39.501484 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:39.502654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:39.557908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:39.558664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:39.559151 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lazy-loading 'fault' on Instance uuid cfdeb888-50e4-4f56-850d-44dab94e033b {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:22:39.649466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:39.651576 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:39.671235 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:39.672665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:39.674487 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:39.675566 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:39.679597 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10fe54c24554b4db6783014a85cfa72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dec64625f54967a0032506f799ed6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:39.698320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f2dfbc4b-34a0-482e-b99f-010f49e1dc08 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 200 len: 1332 microversion: 2.1 time: 0.235481 Jun 15 22:22:39.709492 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 445/906] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:39 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:22:40.251493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:40.262556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:40.264462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:40.266222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-24bfd588-a6a2-4a02-a0bb-cff96955f872 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.621575 Jun 15 22:22:40.267495 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 462/907] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:39 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:40.729116 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:40.730339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:40.740923 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:40.743423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:40.746905 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:40.747451 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:40.776524 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b HTTP/1.1 Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:40.778510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:40.780496 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'cfdeb888-50e4-4f56-850d-44dab94e033b'} Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:40.790769 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:40.792288 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:40.794928 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:40.796886 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6f986d46-9d82-408c-b03d-c52a2ea9e5b4 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 404 len: 111 microversion: 2.1 time: 0.072177 Jun 15 22:22:40.805987 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 446/908] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:40 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:40.823872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-af8ea718-ad00-4512-b785-d16d8d77ee00 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '.version_select at 0x7f99db1ed040>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:40.845110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:40.863634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-af8ea718-ad00-4512-b785-d16d8d77ee00 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098616949" status: 202 len: 0 microversion: 2.1 time: 0.052003 Jun 15 22:22:40.865966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 463/909] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 15 22:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098616949 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:22:41.287259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:41.287485 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:41.306574 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:41.307630 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:41.314312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:41.316989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:41.859393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:41.879449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:41.881435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:41.883135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8d9c7411-149f-4b0a-930c-f85a58c8cf94 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.601249 Jun 15 22:22:41.884086 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 447/910] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:41 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:42.904358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:42.905045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:42.923903 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:42.930638 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:42.933234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:42.933802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:43.325630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:43.342143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:43.344953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:43.346679 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-843b8ab1-422f-41d2-b793-fae160300e63 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.447524 Jun 15 22:22:43.367282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 464/911] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:42 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:43.832623 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:43.833401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:43.835763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:43.886842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:43.892040 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:43.894016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:43.896211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:43.928840 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b HTTP/1.1 Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:43.931605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:43.933393 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': 'cfdeb888-50e4-4f56-850d-44dab94e033b'} Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:43.934412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:43.936016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:43.943425 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:43.944530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7a3f89d4-645d-4341-8be7-3b0c30a4ba6b tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 404 len: 111 microversion: 2.1 time: 0.117087 Jun 15 22:22:43.955271 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 448/912] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:43 2022] DELETE /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:43.960154 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:43.960762 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: cfdeb888-50e4-4f56-850d-44dab94e033b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:43.974710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:43.976478 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:43.978974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:43.980158 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:44.016452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b HTTP/1.1 Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:22:44.019556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:44.021058 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': 'cfdeb888-50e4-4f56-850d-44dab94e033b'} Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:44.021904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. Jun 15 22:22:44.023140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:44.033889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance cfdeb888-50e4-4f56-850d-44dab94e033b could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:44.033889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a12b8c61-b4a0-4d76-9f25-54d6aa9ddcb0 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b" status: 404 len: 111 microversion: 2.1 time: 0.072592 Jun 15 22:22:44.033889 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 465/913] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:43 2022] GET /compute/v2.1/servers/cfdeb888-50e4-4f56-850d-44dab94e033b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:44.369065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:44.369817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:44.376737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:44.377276 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:44.378237 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:44.378741 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:44.605831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:44.615565 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:44.621903 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:44.623513 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-216094db-e479-49a6-8240-8e3f13307a82 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.258662 Jun 15 22:22:44.625251 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 449/914] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:44 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:45.270216 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:45.271344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:45.278837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.280386 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.281413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.282007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.297739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 HTTP/1.1 Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:22:45.299372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.300754 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '1668ceea-e020-4ddb-9ba0-f7081bb6d557'} Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:45.301616 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.306279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.307816 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:45.307816 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-00539646-c4c8-4588-9223-1f2b61c8d2ad tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 404 len: 111 microversion: 2.1 time: 0.034813 Jun 15 22:22:45.307816 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 466/915] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:45 2022] DELETE /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:45.314250 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:45.315401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 1668ceea-e020-4ddb-9ba0-f7081bb6d557] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:45.332684 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.333133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.333957 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.334551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.356266 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 HTTP/1.1 Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:45.358255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.360236 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '1668ceea-e020-4ddb-9ba0-f7081bb6d557'} Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:45.361090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. Jun 15 22:22:45.362553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.365125 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 1668ceea-e020-4ddb-9ba0-f7081bb6d557 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:45.366281 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-df231588-680d-4665-b3a0-07e2a925b7d5 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557" status: 404 len: 111 microversion: 2.1 time: 0.059837 Jun 15 22:22:45.370870 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 450/916] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:45 2022] GET /compute/v2.1/servers/1668ceea-e020-4ddb-9ba0-f7081bb6d557 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:45.378346 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:45.378912 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:45.386100 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.386552 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.387425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.387870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.427569 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 HTTP/1.1 Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:22:45.432118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.433533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '32272089-e3c2-4bf4-b24f-afd378c89989'} Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:45.434263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.435436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.436677 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:45.436677 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-96c2f99f-0aa2-4437-86b8-70e922e29913 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 404 len: 111 microversion: 2.1 time: 0.060888 Jun 15 22:22:45.437024 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 467/917] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:45 2022] DELETE /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:45.450553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:45.451198 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 32272089-e3c2-4bf4-b24f-afd378c89989] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:45.461174 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.461931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.462997 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.463428 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.492556 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 HTTP/1.1 Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:45.494137 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.495868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '32272089-e3c2-4bf4-b24f-afd378c89989'} Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:45.496904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. Jun 15 22:22:45.499965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:45.501317 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 32272089-e3c2-4bf4-b24f-afd378c89989 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:45.501317 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b5f5a04b-34a7-4b86-9c9d-eddd748ba0bf tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989" status: 404 len: 111 microversion: 2.1 time: 0.052413 Jun 15 22:22:45.501317 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 451/918] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:45 2022] GET /compute/v2.1/servers/32272089-e3c2-4bf4-b24f-afd378c89989 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:45.664185 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:45.664798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:45.690736 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.691325 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.692500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:45.692943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:45.907952 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:45.917940 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:45.919930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:45.923844 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd103b3f-08a4-4216-bb12-14be82dcfdae tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.269599 Jun 15 22:22:45.925168 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 468/919] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:45 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:46.714594 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:46.715368 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:46.723633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:46.735217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:46.735217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:46.735217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:46.744897 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 HTTP/1.1 Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:22:46.746751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.748455 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '19c2ed2d-ebef-45a1-a6e7-4b624b642c27'} Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:46.749429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.751697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.754478 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:46.755813 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c7b38558-7874-443c-8a7a-2e05f2f07557 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 404 len: 111 microversion: 2.1 time: 0.045335 Jun 15 22:22:46.757544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 452/920] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:22:46 2022] DELETE /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:46.767234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:46.768452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] [instance: 19c2ed2d-ebef-45a1-a6e7-4b624b642c27] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:46.776151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:46.777379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:46.778382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:46.778965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:46.796416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] HTTP exception thrown: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Request method failure captured: Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 HTTP/1.1 Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqloTWkb0xt8Vm9fdY1Y45JTVGBsU_An12JmZw-ApDpcB70NPWWDa1DjPuAMm7ICxfgxS4V2V1ADalOg25QGUGtyj5EYwV_GUv7psvy1pm7JI77tSl-QwL_ofej68f2junRX25pTlkrzkI_cE--RAaKU5tAhMDUHfDv9iEcF78TFV8ro Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:22:46.798685 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e2dec64625f54967a0032506f799ed6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e2dec64625f54967a0032506f799ed6a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e2dec64625f54967a0032506f799ed6a Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1159020616 Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c10fe54c24554b4db6783014a85cfa72 Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1159020616-project Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.800465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '19c2ed2d-ebef-45a1-a6e7-4b624b642c27'} Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:22:46.801494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. Jun 15 22:22:46.803027 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:22:46.804554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] Returning 404 to user: Instance 19c2ed2d-ebef-45a1-a6e7-4b624b642c27 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:22:46.804554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9a9ca184-3811-4afc-80b1-41acdf457f84 tempest-AttachVolumeNegativeTest-1159020616 tempest-AttachVolumeNegativeTest-1159020616-project] 10.222.0.55 "GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27" status: 404 len: 111 microversion: 2.1 time: 0.038392 Jun 15 22:22:46.804554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 469/921] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:46 2022] GET /compute/v2.1/servers/19c2ed2d-ebef-45a1-a6e7-4b624b642c27 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:46.942290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:46.942812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:46.949309 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:46.949834 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:46.950611 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:46.950990 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:47.152583 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:47.166192 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:47.168693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:47.170545 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7490683e-8b11-42f5-8eb3-2b194dc198d1 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.232109 Jun 15 22:22:47.179314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 453/922] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:46 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:48.195598 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:48.196759 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:48.215791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:48.216494 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:48.217563 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:48.218447 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:48.251910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:48.513895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:48.524339 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:48.530287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:48.539266 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-374c925e-dfb0-480b-971a-0d9484c37867 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.347722 Jun 15 22:22:48.539870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 470/923] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:48 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:49.558502 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:49.559694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:49.575234 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:49.575786 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:49.576746 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:49.577531 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:49.759605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:49.767965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:49.769517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:49.770877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-efd266b1-e860-4e84-8d62-c00f191374f5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.216645 Jun 15 22:22:49.771461 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 454/924] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:49 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:50.790331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:50.790958 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:50.798239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:50.798979 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:50.800025 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:50.800640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:51.051523 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:51.062134 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:51.064322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:51.065658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f2d7c869-f1ec-4b27-aa6d-3a2c837d80be tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.279318 Jun 15 22:22:51.066961 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 471/925] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:50 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:52.089664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:52.090592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:52.098866 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:52.099569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:52.100658 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:52.101373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:52.167608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1680618296", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2118278866", "security_groups": [{"name": "tempest-secgroup-smoke-1560717700"}], "networks": [{"uuid": "2639197b-57e3-474f-bfde-2855daaf8c0c"}], "block_device_mapping_v2": [{"uuid": "08f24be6-6927-4388-8aad-a87b541dc155", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:52.292980 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:52.308209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:52.314473 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:52.316828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:52.318624 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e2ef01f5-ec46-42ea-a783-490a5023bd5a tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.235387 Jun 15 22:22:52.330755 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 455/926] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:52 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:52.368466 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] validate_networks() for [('2639197b-57e3-474f-bfde-2855daaf8c0c', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:22:52.802099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:22:52.802502 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:22:52.802963 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:22:52.803365 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:22:52.803771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:22:52.812629 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:52.813075 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:52.813918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:52.814347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:52.832599 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Getting quotas for project 1bc7b00884114a089c6d2c785fc8e9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:22:52.838288 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Getting quotas for user fb2ceaafe83f4d67ae9ea6492b21a850 and project 1bc7b00884114a089c6d2c785fc8e9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:22:52.896644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:22:52.899077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08f24be6-6927-4388-8aad-a87b541dc155',volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:22:53.052499 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-418a0269-a5f1-4161-8a32-8d1e49d48688 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.889398 Jun 15 22:22:53.053193 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 472/927] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:22:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 22:22:53.064213 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1ad97df-46b7-44c9-952d-1b0ce0bfd3e3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:53.064930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d1ad97df-46b7-44c9-952d-1b0ce0bfd3e3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:53.162548 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d1ad97df-46b7-44c9-952d-1b0ce0bfd3e3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:53.172671 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d1ad97df-46b7-44c9-952d-1b0ce0bfd3e3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1089 microversion: 2.1 time: 0.110790 Jun 15 22:22:53.177895 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 456/928] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:53 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1089 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:53.337789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:53.338984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:53.347424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:53.348050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:53.348980 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:53.349579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:53.502825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:53.511352 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:53.512837 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:53.514943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3dfe47ac-c4a2-4e22-9068-e284ee80c999 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.181569 Jun 15 22:22:53.515661 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 473/929] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:53 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:54.189873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:54.191235 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:54.216566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:54.217006 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:54.217830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:54.218324 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:54.327564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:54.339265 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-901d9703-8d2a-4d07-b7f8-5d6cd723ad08 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1195 microversion: 2.1 time: 0.152170 Jun 15 22:22:54.349409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 457/930] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:54 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1195 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:54.535310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:54.535895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:54.542798 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:54.543250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:54.544017 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:54.544462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:54.689156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:54.697623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:54.699103 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:54.700254 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78f88283-45e0-405a-ad93-cb60969ef398 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.169475 Jun 15 22:22:54.700799 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 474/931] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:54 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:55.360151 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:55.361182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:55.369712 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:55.370297 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:55.371269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:55.371735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:55.451584 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:55.466431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-15061fb8-1010-47f5-9fa2-375645067835 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1205 microversion: 2.1 time: 0.108058 Jun 15 22:22:55.466431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 458/932] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:55 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1205 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:55.720380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:55.721544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:55.729938 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:55.730505 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:55.731644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:55.732151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:55.876780 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:55.885444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:55.886921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:55.888073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4bb1bd86-7a57-46bf-af6f-9023cabe00c7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.172976 Jun 15 22:22:55.888642 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 475/933] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:55 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:22:56.139717 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-aea0e68e-93b7-4a9f-8896-ce49e42209d2 req-45e4a136-c511-4fff-9b17-cf5197eaaee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "name": "network-vif-plugged", "status": "completed", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:56.148744 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-aea0e68e-93b7-4a9f-8896-ce49e42209d2 req-45e4a136-c511-4fff-9b17-cf5197eaaee0 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:56.149269 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-aea0e68e-93b7-4a9f-8896-ce49e42209d2 req-45e4a136-c511-4fff-9b17-cf5197eaaee0 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:56.162904 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-aea0e68e-93b7-4a9f-8896-ce49e42209d2 req-45e4a136-c511-4fff-9b17-cf5197eaaee0 service nova] Creating event network-vif-plugged:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:22:56.168116 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-aea0e68e-93b7-4a9f-8896-ce49e42209d2 req-45e4a136-c511-4fff-9b17-cf5197eaaee0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032072 Jun 15 22:22:56.168715 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 459/934] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:56.481303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:56.481303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:56.486578 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:56.487015 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:56.487785 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:56.488211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:56.561745 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:56.571147 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cb47ee37-8a7a-4612-9590-25e2d70fec1c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1205 microversion: 2.1 time: 0.096029 Jun 15 22:22:56.571697 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 476/935] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:56 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1205 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:22:56.908223 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:56.908951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:56.916166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:56.916620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:56.917396 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:56.917834 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:57.178329 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:57.190000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:57.191554 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:57.192785 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b944a5e8-cbdd-4c70-85ec-9f7dd9b06690 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.289186 Jun 15 22:22:57.193586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 460/936] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:56 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:57.589246 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:57.590547 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:57.599903 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:57.600128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:57.600949 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:57.601670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:57.753859 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:57.762718 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-33efeb74-7184-4683-a34b-f35de22462b1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1273 microversion: 2.1 time: 0.177754 Jun 15 22:22:57.768785 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 477/937] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:57 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:58.213350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:58.214035 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:58.221854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:58.222589 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:58.223569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:58.224012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:58.478373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:58.487807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:58.489291 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:58.490488 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-19a4bc2e-e789-41cf-8b58-ab3b68af59d7 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.281713 Jun 15 22:22:58.491049 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 461/938] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:58 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:22:58.780318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:58.780929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:58.787740 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:58.788487 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:58.789710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:58.790472 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:58.967160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-377f11b4-3fd4-4b4c-b765-b92c043326d0 req-9bf3c9ec-f9cb-4025-9526-f3c75d4d8610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:22:58.973849 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:58.974617 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:58.980144 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-377f11b4-3fd4-4b4c-b765-b92c043326d0 req-9bf3c9ec-f9cb-4025-9526-f3c75d4d8610 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:58.980482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-377f11b4-3fd4-4b4c-b765-b92c043326d0 req-9bf3c9ec-f9cb-4025-9526-f3c75d4d8610 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:58.998773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6eb87187-0763-490a-bd25-801d09421050 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.222143 Jun 15 22:22:59.008947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 478/939] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:22:58 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:22:59.009243 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-377f11b4-3fd4-4b4c-b765-b92c043326d0 req-9bf3c9ec-f9cb-4025-9526-f3c75d4d8610 service nova] Creating event network-changed:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:22:59.015743 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-377f11b4-3fd4-4b4c-b765-b92c043326d0 req-9bf3c9ec-f9cb-4025-9526-f3c75d4d8610 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052802 Jun 15 22:22:59.016537 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 462/940] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:22:59.511401 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:22:59.514046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:22:59.519479 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:59.519936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:59.520694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:22:59.521152 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:22:59.663882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:59.675854 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:59.677389 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:22:59.678557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3ad5afdd-20c2-4b6c-bf7f-f56e1153c4b8 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.173537 Jun 15 22:22:59.679132 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 479/941] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:22:59 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:23:00.018116 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:00.018815 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:00.025876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:00.027642 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:00.027642 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:00.027857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:00.174318 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:00.182035 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9768ab4f-c5d2-4fe8-b229-a04c3b365b63 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.168900 Jun 15 22:23:00.182596 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 463/942] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:00 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:00.697499 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:00.698157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:00.705159 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:00.705623 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:00.706412 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:00.706841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:00.856565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:00.866588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:00.868071 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:00.869240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-efe51d4a-b58a-4e8a-9942-429ee48332ce tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1731 microversion: 2.20 time: 0.175850 Jun 15 22:23:00.869863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 480/943] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:00 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:23:01.199562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:01.200047 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:01.211041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:01.214406 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:01.215321 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:01.216121 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:01.531342 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:01.541903 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-59d50e2d-f8aa-409f-ba41-3593f0298ace tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.346186 Jun 15 22:23:01.543232 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 464/944] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:01 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:01.888332 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:01.888936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:01.895813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:01.896293 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:01.897057 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:01.897547 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:02.036642 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:02.045511 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:02.047081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:02.048281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-709f3717-a125-4bb2-989b-9f995a955a70 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1718 microversion: 2.20 time: 0.163920 Jun 15 22:23:02.048825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 481/945] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:01 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:23:02.562982 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:02.563716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:02.570605 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:02.571420 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:02.572267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:02.572703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:02.714463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:02.725689 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2c4849f2-9f13-488b-a174-9cb6e59dc202 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.166616 Jun 15 22:23:02.726339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 465/946] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:02 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:03.744377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:03.745004 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:03.747141 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:03.747811 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:03.755136 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:03.755581 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:03.756373 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:03.756833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:03.901276 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:03.910249 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-700163ba-432f-4161-9c3b-da7cdee9cce1 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.169899 Jun 15 22:23:03.910825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 482/947] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:03 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:04.927308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:04.927881 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:04.930067 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:04.935994 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:04.936463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:04.937216 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:04.937699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:05.105509 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:05.114627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-48d36cef-6f57-4189-99f4-e9b5faa40098 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.191273 Jun 15 22:23:05.115713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 466/948] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:04 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:06.132338 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:06.133265 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:06.141209 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:06.141695 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:06.142510 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:06.142953 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:06.290818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:06.299996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6f4e8eee-d307-44c7-acdf-63403cf57734 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.171878 Jun 15 22:23:06.300739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 483/949] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:06 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:23:07.317011 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:07.317886 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:07.324378 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:07.324827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:07.325623 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:07.326059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:07.469955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:07.478544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5f6c24e4-dc22-41fa-8225-906e2b3a83d8 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.165704 Jun 15 22:23:07.479185 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 467/950] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:07 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:08.496970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:08.497778 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:08.505715 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:08.506654 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:08.507696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:08.508579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:08.667415 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:08.676131 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3b50a6c9-1f0e-456c-a8f0-2e18b0353413 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.184484 Jun 15 22:23:08.676859 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 484/951] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:08 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:09.693557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:09.694260 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:09.705356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:09.705804 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:09.709037 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:09.709515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:09.861670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:09.871372 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f66a2074-53ec-40f3-b107-5e169fb600c6 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.183003 Jun 15 22:23:09.871945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 468/952] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:09 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:10.894164 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:10.895551 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:10.903217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:10.903668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:10.904446 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:10.904878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:11.050519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:11.061009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-09c5ff07-9939-46a5-95f4-79586de960c4 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.171316 Jun 15 22:23:11.061977 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 485/953] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:10 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:23:11.197560 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-60b127b6-dce7-4030-a1d6-60505a20611f req-a277f028-cd60-4dcc-9a49-980052e360bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "name": "network-vif-plugged", "status": "completed", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:23:11.211166 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-60b127b6-dce7-4030-a1d6-60505a20611f req-a277f028-cd60-4dcc-9a49-980052e360bb service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:11.211983 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-60b127b6-dce7-4030-a1d6-60505a20611f req-a277f028-cd60-4dcc-9a49-980052e360bb service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:11.226795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-60b127b6-dce7-4030-a1d6-60505a20611f req-a277f028-cd60-4dcc-9a49-980052e360bb service nova] Creating event network-vif-plugged:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:23:11.232757 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-60b127b6-dce7-4030-a1d6-60505a20611f req-a277f028-cd60-4dcc-9a49-980052e360bb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039073 Jun 15 22:23:11.234351 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 469/954] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:23:12.078383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:12.079153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:12.088441 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:12.089008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:12.089955 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:12.090393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:12.225107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:12.233221 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ccd2dc2e-83b2-45f1-bb37-a0f03a1f9c6e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.158745 Jun 15 22:23:12.241519 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 486/955] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:12 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:13.257292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:13.258118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:13.265615 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:13.266010 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:13.266791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:13.267610 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:13.412591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:13.420864 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1e064ac8-8eda-40a6-b58f-e1ee6fa26452 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.169297 Jun 15 22:23:13.421490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 470/956] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:13 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:14.438255 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:14.438890 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:14.441500 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:14.447742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:14.448259 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:14.449127 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:14.449644 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:14.467268 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:14.604465 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:14.612767 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8eb9ac60-dc8e-48e4-9fc2-77232d48c4f5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1261 microversion: 2.1 time: 0.178844 Jun 15 22:23:14.613394 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 487/957] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:14 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:15.631080 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:15.631686 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:15.638679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:15.639097 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:15.639857 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:15.640286 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:15.789862 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:15.798159 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-434fd956-b5cb-49e2-8ba3-7328481aa75b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1446 microversion: 2.1 time: 0.171195 Jun 15 22:23:15.798989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 471/958] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:15 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:15.816995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:15.817630 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:15.824247 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:15.824703 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:15.825510 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:15.825946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:15.967885 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:15.974773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d9163e6d-9ef1-4c72-8e9e-427e4231fbdc tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1446 microversion: 2.1 time: 0.162735 Jun 15 22:23:15.975355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 488/959] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:23:15 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:23:18.189831 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-0ea19df8-1037-42a8-8d5c-01466f45002c req-2938cf67-d018-481f-8aea-1135ff766569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:23:18.200719 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0ea19df8-1037-42a8-8d5c-01466f45002c req-2938cf67-d018-481f-8aea-1135ff766569 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:18.201158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0ea19df8-1037-42a8-8d5c-01466f45002c req-2938cf67-d018-481f-8aea-1135ff766569 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:18.224480 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-0ea19df8-1037-42a8-8d5c-01466f45002c req-2938cf67-d018-481f-8aea-1135ff766569 service nova] Creating event network-changed:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:23:18.232054 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-0ea19df8-1037-42a8-8d5c-01466f45002c req-2938cf67-d018-481f-8aea-1135ff766569 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046286 Jun 15 22:23:18.234183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 472/960] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:23:34.711749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:34.712952 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:34.715344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:34.716112 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=9 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:34.722789 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:34.723347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:34.727545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:34.727545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:34.760310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0b035ef4-bc3d-4311-8172-79d455882bc0 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053055 Jun 15 22:23:34.761084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 489/961] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 15 22:23:34 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:23:34.826216 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=21 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:34.827058 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=80 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:34.832007 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:34.833995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:34.840699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:34.841004 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:34.841838 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:34.842249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:34.869964 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:23:34.972290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-810b1bcc-2061-423b-bd3c-f48a987c4d8b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 204 len: 0 microversion: 2.20 time: 0.147356 Jun 15 22:23:34.973009 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 473/962] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 15 22:23:34 2022] DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 22:23:34.985279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:34.986302 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:34.996824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:34.997520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:34.998816 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:34.999328 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:35.190707 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:35.201207 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:35.203174 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:35.204400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-506ab5bd-a19d-4968-b008-4b7896f04407 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.226249 Jun 15 22:23:35.205528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 490/963] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:34 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 22:23:36.230731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:36.231525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:36.239728 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:36.240182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:36.240967 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:36.241434 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:36.395712 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:36.404802 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:36.406354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:36.407511 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8be9f010-7ca1-4442-aaf7-5b988d58b90e tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1724 microversion: 2.20 time: 0.181426 Jun 15 22:23:36.408067 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 474/964] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:36 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:23:37.427486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:37.428718 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:37.436353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:37.437287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:37.438371 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:37.439034 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:37.518805 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:37.528848 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:37.533006 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97aa07a49016448d9b1067ce0dbd8d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1593797d34a04b169379da1a51e18072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:23:37.534347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a18fd249-5ca5-4610-92dd-3484e196074b tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 200 len: 1656 microversion: 2.20 time: 0.111290 Jun 15 22:23:37.535333 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 491/965] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:37 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 1656 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 22:23:37.632112 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-94fb5355-afa7-4b93-a0bb-9dfa691931cb req-b08f7146-8db7-4296-bd44-983416ff868b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68873eb8-8080-4f9a-ab71-0335149287b4", "name": "network-vif-deleted", "tag": "f1bca41c-6fc6-43de-a971-91dcd12aada2"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:23:37.652158 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-94fb5355-afa7-4b93-a0bb-9dfa691931cb req-b08f7146-8db7-4296-bd44-983416ff868b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:37.652919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-94fb5355-afa7-4b93-a0bb-9dfa691931cb req-b08f7146-8db7-4296-bd44-983416ff868b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:37.669415 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-94fb5355-afa7-4b93-a0bb-9dfa691931cb req-b08f7146-8db7-4296-bd44-983416ff868b service nova] Creating event network-vif-deleted:f1bca41c-6fc6-43de-a971-91dcd12aada2 for instance 68873eb8-8080-4f9a-ab71-0335149287b4 on hv-cinder-83538 Jun 15 22:23:37.677220 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-94fb5355-afa7-4b93-a0bb-9dfa691931cb req-b08f7146-8db7-4296-bd44-983416ff868b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049157 Jun 15 22:23:37.678401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 475/966] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:23:38.560603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:38.561221 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:38.571142 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:38.571538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:38.577286 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:38.577762 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:38.594350 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] HTTP exception thrown: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Request method failure captured: Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 HTTP/1.1 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlptW8ZKu9Mh_5uu_X2uFU9nkEO_k2xg7DgQ1QuswfmXNPgWOKrIkYfDChKlqfrTtvd3ZgXsZZ6CasVEfqj013V-4gZbdCfTZfTCMvRc-0xa6aeW9x4H6QsBOcvF-PCjLLRkUgVrq0FfCjXARvHsQeb7Zl37QfWav9UiSQZjoURT84o Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:23:38.596245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1593797d34a04b169379da1a51e18072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1593797d34a04b169379da1a51e18072", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 97aa07a49016448d9b1067ce0dbd8d99 Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:38.598690 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '68873eb8-8080-4f9a-ab71-0335149287b4'} Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:23:38.600191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:38.602701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:38.604397 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Returning 404 to user: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:23:38.604397 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-745ca65e-00dc-44c9-b292-a956893a19c5 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 404 len: 111 microversion: 2.20 time: 0.049223 Jun 15 22:23:38.606285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 492/967] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:38 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:23:38.620901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9ac1e1ad-ef5b-44e2-b61e-34862b23aacc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '.version_select at 0x7f99db2ad700>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:38.645259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9ac1e1ad-ef5b-44e2-b61e-34862b23aacc tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122543907" status: 204 len: 0 microversion: 2.20 time: 0.036859 Jun 15 22:23:38.649176 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 476/968] 10.222.0.55 () {60 vars in 1261 bytes} [Wed Jun 15 22:23:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122543907 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 22:23:40.819173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:40.819734 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:40.827074 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:40.828032 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:40.829143 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:40.829777 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:40.870492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] HTTP exception thrown: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Request method failure captured: Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 HTTP/1.1 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlptW8ZKu9Mh_5uu_X2uFU9nkEO_k2xg7DgQ1QuswfmXNPgWOKrIkYfDChKlqfrTtvd3ZgXsZZ6CasVEfqj013V-4gZbdCfTZfTCMvRc-0xa6aeW9x4H6QsBOcvF-PCjLLRkUgVrq0FfCjXARvHsQeb7Zl37QfWav9UiSQZjoURT84o Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:23:40.873073 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1593797d34a04b169379da1a51e18072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1593797d34a04b169379da1a51e18072", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 97aa07a49016448d9b1067ce0dbd8d99 Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.874746 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '68873eb8-8080-4f9a-ab71-0335149287b4'} Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:23:40.875614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.876918 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.880891 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Returning 404 to user: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:23:40.882312 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-16183d6e-67bb-4c9a-b1c3-5f8f6c0ed743 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 404 len: 111 microversion: 2.20 time: 0.068438 Jun 15 22:23:40.883408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 493/969] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 15 22:23:40 2022] DELETE /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:23:40.898934 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:40.899749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 68873eb8-8080-4f9a-ab71-0335149287b4] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:40.907176 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:40.907619 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:40.908441 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:40.908879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:40.924934 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] HTTP exception thrown: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Request method failure captured: Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 HTTP/1.1 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlptW8ZKu9Mh_5uu_X2uFU9nkEO_k2xg7DgQ1QuswfmXNPgWOKrIkYfDChKlqfrTtvd3ZgXsZZ6CasVEfqj013V-4gZbdCfTZfTCMvRc-0xa6aeW9x4H6QsBOcvF-PCjLLRkUgVrq0FfCjXARvHsQeb7Zl37QfWav9UiSQZjoURT84o Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:23:40.932963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1593797d34a04b169379da1a51e18072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1593797d34a04b169379da1a51e18072", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 97aa07a49016448d9b1067ce0dbd8d99 Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.934692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '68873eb8-8080-4f9a-ab71-0335149287b4'} Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:23:40.935704 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. Jun 15 22:23:40.937160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:40.944395 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Returning 404 to user: Instance 68873eb8-8080-4f9a-ab71-0335149287b4 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:23:40.945603 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ce4ce0f7-b2b6-4e88-b092-393ae4289f07 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4" status: 404 len: 111 microversion: 2.20 time: 0.056157 Jun 15 22:23:40.946525 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 477/970] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:40 2022] GET /compute/v2.1/servers/68873eb8-8080-4f9a-ab71-0335149287b4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:23:42.147244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:42.147244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:42.155043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:42.155886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:42.156741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:42.157430 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:42.174324 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] HTTP exception thrown: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Request method failure captured: Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 HTTP/1.1 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlptW8ZKu9Mh_5uu_X2uFU9nkEO_k2xg7DgQ1QuswfmXNPgWOKrIkYfDChKlqfrTtvd3ZgXsZZ6CasVEfqj013V-4gZbdCfTZfTCMvRc-0xa6aeW9x4H6QsBOcvF-PCjLLRkUgVrq0FfCjXARvHsQeb7Zl37QfWav9UiSQZjoURT84o Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:23:42.176950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1593797d34a04b169379da1a51e18072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1593797d34a04b169379da1a51e18072", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 97aa07a49016448d9b1067ce0dbd8d99 Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.178408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '503192ac-2c7e-41e2-821a-7ae04c7020c0'} Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:23:42.179150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.180380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.183231 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Returning 404 to user: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:23:42.184353 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-67e3405d-431d-4101-b2d2-5503c93ad755 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 404 len: 111 microversion: 2.20 time: 0.041846 Jun 15 22:23:42.188382 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 494/971] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 15 22:23:42 2022] DELETE /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 22:23:42.197510 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:23:42.198211 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] [instance: 503192ac-2c7e-41e2-821a-7ae04c7020c0] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:23:42.205218 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:42.205713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:42.206928 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:23:42.207387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:23:42.223639 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] HTTP exception thrown: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Request method failure captured: Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 HTTP/1.1 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlptW8ZKu9Mh_5uu_X2uFU9nkEO_k2xg7DgQ1QuswfmXNPgWOKrIkYfDChKlqfrTtvd3ZgXsZZ6CasVEfqj013V-4gZbdCfTZfTCMvRc-0xa6aeW9x4H6QsBOcvF-PCjLLRkUgVrq0FfCjXARvHsQeb7Zl37QfWav9UiSQZjoURT84o Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:23:42.225206 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1593797d34a04b169379da1a51e18072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1593797d34a04b169379da1a51e18072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1593797d34a04b169379da1a51e18072", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 1593797d34a04b169379da1a51e18072 Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053095688 Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: 97aa07a49016448d9b1067ce0dbd8d99 Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053095688-project Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.226885 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '503192ac-2c7e-41e2-821a-7ae04c7020c0'} Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:23:42.231971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. Jun 15 22:23:42.234008 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:23:42.235153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] Returning 404 to user: Instance 503192ac-2c7e-41e2-821a-7ae04c7020c0 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:23:42.235153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7c37acc6-5814-46c3-95f8-e789d08bbd65 tempest-AttachVolumeShelveTestJSON-1053095688 tempest-AttachVolumeShelveTestJSON-1053095688-project] 10.222.0.55 "GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0" status: 404 len: 111 microversion: 2.20 time: 0.033974 Jun 15 22:23:42.235153 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 478/972] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 15 22:23:42 2022] GET /compute/v2.1/servers/503192ac-2c7e-41e2-821a-7ae04c7020c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 22:24:02.124625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=12 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:02.125420 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=24 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:02.129902 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dd9dfe10-3499-4cf8-bc25-253cf695ab0e tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Action: 'create', calling method: .version_select at 0x7f99db1c3c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1143524641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZQvOR2jvub3sCizWso4ildS2Sqqrn3nLlrEnuhJN1Kl4N3L2yGOV7eplk55cwolJKtOJDcdEhsvJK5DzwtYI1N9gNvVxc/F19Dk4ThOqGD7EGaIUwxqGQUwOlzBncHeA=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:02.147751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-dd9dfe10-3499-4cf8-bc25-253cf695ab0e tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Getting quotas for project 0d141f1b8c984a5a9fbf2fb3c8f01b2b. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:24:02.152916 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-dd9dfe10-3499-4cf8-bc25-253cf695ab0e tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Getting quotas for user 0df0a42b2f2442e2a34b6538311212aa and project 0d141f1b8c984a5a9fbf2fb3c8f01b2b. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:24:02.178287 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dd9dfe10-3499-4cf8-bc25-253cf695ab0e tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054665 Jun 15 22:24:02.178871 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 495/973] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:24:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:24:02.292216 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-978330263", "imageRef": "16cef3ac-b74d-40c6-b96e-5822fee7e0b7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1143524641", "networks": [{"uuid": "704d5041-1821-4a58-8137-a7c4880d5c2e"}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:02.306196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:02.307121 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:02.370068 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] validate_networks() for [('704d5041-1821-4a58-8137-a7c4880d5c2e', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:24:02.806966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:24:02.807421 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:24:02.807912 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:24:02.808454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:24:02.808913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:24:02.818892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:02.819573 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:02.820401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:02.820827 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:02.838394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Getting quotas for project 0d141f1b8c984a5a9fbf2fb3c8f01b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:24:02.842217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Getting quotas for user 0df0a42b2f2442e2a34b6538311212aa and project 0d141f1b8c984a5a9fbf2fb3c8f01b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:24:02.853561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:24:02.855759 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16cef3ac-b74d-40c6-b96e-5822fee7e0b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:24:02.904470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [07919f2c-9199-46a4-96a5-ca45086b383a] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 22:24:03.913017 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [07919f2c-9199-46a4-96a5-ca45086b383a] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 49464. Jun 15 22:24:03.919305 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-56b9062d-ae1d-4039-bbef-e6bdda57188a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632522 Jun 15 22:24:03.920569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 479/974] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 22:24:03.932906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-08800080-0fc7-4726-96b6-3c4c51bd094f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:03.934093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-08800080-0fc7-4726-96b6-3c4c51bd094f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:03.994603 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-08800080-0fc7-4726-96b6-3c4c51bd094f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:04.002379 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-08800080-0fc7-4726-96b6-3c4c51bd094f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1258 microversion: 2.1 time: 0.074939 Jun 15 22:24:04.002995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 496/975] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:03 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:05.021091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:05.021670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:05.028681 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:05.029135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:05.029987 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:05.030571 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:05.105949 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:05.116961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9843569a-aea4-48d8-a304-2b790dc6b015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1262 microversion: 2.1 time: 0.100863 Jun 15 22:24:05.117890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 480/976] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:05 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1262 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:06.134764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:06.135375 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:06.142725 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:06.143173 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:06.143957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:06.144391 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:06.210245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:06.218301 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e430b08b-10e9-43bb-9545-dcd51d199054 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1262 microversion: 2.1 time: 0.087368 Jun 15 22:24:06.219205 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 497/977] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:06 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:07.237472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:07.238734 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:07.247660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:07.248231 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:07.249205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:07.249793 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:07.322296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:07.330763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a11e7713-af6d-474b-99af-3036dbab02f9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1310 microversion: 2.1 time: 0.098309 Jun 15 22:24:07.331478 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 481/978] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:07 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:08.350451 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:08.351681 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:08.372659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:08.373406 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:08.379192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:08.379801 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:08.514903 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:08.527075 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7f1d28b5-4dc6-4b16-a3f1-70a42472fc55 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1316 microversion: 2.1 time: 0.182388 Jun 15 22:24:08.529784 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 498/979] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:08 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:09.561795 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:09.562470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:09.578805 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:09.579268 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:09.580115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:09.580592 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:10.255238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:10.275150 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2affff9a-415f-4b64-a6bc-35f222557d60 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.712698 Jun 15 22:24:10.276356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 482/980] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:09 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:10.701452 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-e219e63f-3d79-4f32-af1e-d7d68d4e76ca req-6a692aa5-a9f8-4310-94da-91173f2b8923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:10.717528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e219e63f-3d79-4f32-af1e-d7d68d4e76ca req-6a692aa5-a9f8-4310-94da-91173f2b8923 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:10.718462 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e219e63f-3d79-4f32-af1e-d7d68d4e76ca req-6a692aa5-a9f8-4310-94da-91173f2b8923 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:10.741187 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-e219e63f-3d79-4f32-af1e-d7d68d4e76ca req-6a692aa5-a9f8-4310-94da-91173f2b8923 service nova] Creating event network-changed:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:24:10.751659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-e219e63f-3d79-4f32-af1e-d7d68d4e76ca req-6a692aa5-a9f8-4310-94da-91173f2b8923 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054002 Jun 15 22:24:10.758708 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 499/981] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:24:11.294456 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:11.295022 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:11.306044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:11.309981 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:11.310858 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:11.311342 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:11.510991 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:11.520907 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cb1fb467-db1d-44e0-a695-150da9775806 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.230819 Jun 15 22:24:11.531247 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 483/982] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:11 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:12.539758 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:12.540583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:12.548040 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:12.548497 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:12.549276 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:12.549739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:12.713862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:12.724604 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a5006c20-2b84-43c7-b49c-33ca6573e075 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.188068 Jun 15 22:24:12.725232 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 500/983] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:12 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:13.741763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:13.742361 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:13.744828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:13.745536 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:13.751833 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:13.752294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:13.753082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:13.753590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:13.900985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:13.908961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-68f5b466-d015-43c2-a0ce-3c5159f67aac tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.171525 Jun 15 22:24:13.909824 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 484/984] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:13 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:14.929380 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:14.930042 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:14.932682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:14.939413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:14.939868 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:14.940653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:14.941093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:15.084308 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:15.092195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-96dba309-0a49-4f8c-81db-105490033076 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.168451 Jun 15 22:24:15.092813 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 501/985] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:14 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:16.110778 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:16.112256 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:16.119883 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:16.120620 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:16.121631 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:16.122084 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:16.269942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:16.278238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a4bf454c-61f2-4ffd-b1a3-4bb27fb9b059 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.172244 Jun 15 22:24:16.278815 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 485/986] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:16 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:17.297594 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:17.298213 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:17.305682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:17.306124 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:17.306894 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:17.307318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:17.456814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:17.465870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d65e16de-fd2b-46e1-a75c-7cd7131e6a0a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.172213 Jun 15 22:24:17.466134 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 502/987] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:17 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:18.484279 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:18.485299 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:18.492828 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:18.493273 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:18.494094 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:18.494527 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:18.639791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:18.650871 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-06c6b3ba-9b15-41f2-a638-5517e6252ddb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.170087 Jun 15 22:24:18.651475 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 486/988] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:18 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:19.670149 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:19.670764 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:19.677498 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:19.677976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:19.678935 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:19.679361 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:19.815899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:19.825068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fbfb1dc2-339e-45a2-bfbd-1ffe2696ffe0 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.158961 Jun 15 22:24:19.825773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 503/989] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:19 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:20.843066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:20.843772 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:20.851245 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:20.851787 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:20.852574 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:20.852998 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:21.004249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:21.015298 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4f3ee058-18e4-4614-adfa-2acd71ee975b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.175866 Jun 15 22:24:21.015961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 487/990] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:20 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:22.036625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:22.037252 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:22.044501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:22.044956 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:22.045749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:22.046181 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:22.183670 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:22.192238 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7a4b93a7-f080-45a7-8cb4-e9806b87b8aa tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.161609 Jun 15 22:24:22.192960 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 504/991] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:22 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:23.210498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:23.211207 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:23.218761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:23.219221 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:23.220067 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:23.220498 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:23.374749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:23.383179 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8382517d-c056-4756-bbb8-44797f509ab2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.176719 Jun 15 22:24:23.385940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 488/992] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:23 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:24.401988 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:24.402608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:24.409348 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:24.409824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:24.410613 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:24.411045 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:24.555183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:24.562796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-87ea1c8b-cf7c-48fd-ac29-d3b8667ba8e9 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.165141 Jun 15 22:24:24.563981 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 505/993] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:24 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:25.579851 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:25.587732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:25.591708 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:25.592167 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:25.592946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:25.594092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:25.743027 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:25.751903 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-36b9876a-0615-4cbc-9671-87cb04a2c76d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.175818 Jun 15 22:24:25.752572 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 489/994] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:25 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:26.768737 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:26.769455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:26.776947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:26.777429 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:26.778366 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:26.778830 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:26.927150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:26.935038 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e6927abe-bb4a-45f9-a366-1232353bc918 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.170147 Jun 15 22:24:26.935620 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 506/995] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:26 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:27.591923 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-83b414d8-fdd5-4a56-906c-f7e0b9557a98 req-1ae6b123-31ee-4a88-b054-079e19b4cb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "name": "network-vif-plugged", "status": "completed", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:27.600989 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-83b414d8-fdd5-4a56-906c-f7e0b9557a98 req-1ae6b123-31ee-4a88-b054-079e19b4cb62 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:27.601553 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-83b414d8-fdd5-4a56-906c-f7e0b9557a98 req-1ae6b123-31ee-4a88-b054-079e19b4cb62 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:27.618699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-83b414d8-fdd5-4a56-906c-f7e0b9557a98 req-1ae6b123-31ee-4a88-b054-079e19b4cb62 service nova] Creating event network-vif-plugged:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:24:27.625806 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-83b414d8-fdd5-4a56-906c-f7e0b9557a98 req-1ae6b123-31ee-4a88-b054-079e19b4cb62 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037509 Jun 15 22:24:27.627267 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 490/996] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:24:27.952711 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:27.953289 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:27.960625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:27.961111 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:27.961996 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:27.962434 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:28.101570 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:28.109425 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9637f24a-857a-48a1-bf01-3151cded2130 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1358 microversion: 2.1 time: 0.160750 Jun 15 22:24:28.110006 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 507/997] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:27 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:29.127335 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:29.127966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:29.135771 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.136210 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.136974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.137429 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.277958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:29.286085 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b5aaaeb6-ea91-49cc-9387-62d8ad25b560 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1548 microversion: 2.1 time: 0.163036 Jun 15 22:24:29.286901 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 491/998] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:29 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:29.303492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:29.304363 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:29.312355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.312901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.314009 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.314556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.466400 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:29.475750 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-41e47e0f-c978-4132-bcca-8f8d0b4a7cfb tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1548 microversion: 2.1 time: 0.175931 Jun 15 22:24:29.476549 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 508/999] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:29 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:29.493046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:29.496867 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:29.497735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Searching by: {'deleted': False, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b'} {{(pid=117630) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 22:24:29.504803 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.505348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.506197 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.506665 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.597598 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.multi_cell_list [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117630) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 22:24:29.695202 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e788855b-4db8-4b59-9f0c-415365b4a8ff tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206336 Jun 15 22:24:29.696107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 492/1000] 10.222.0.55 () {58 vars in 1124 bytes} [Wed Jun 15 22:24:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:24:29.708029 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:29.708628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:29.715618 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.716077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.716851 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:29.717290 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:29.867914 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:29.875592 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-876868b2-529b-4670-9d0a-8c2554a6b8b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1548 microversion: 2.1 time: 0.171382 Jun 15 22:24:29.876147 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 509/1001] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:29 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:31.453533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48e163fd-39b4-4384-9716-ab675f7d9763"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:31.454663 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:31.462387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:31.462829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:31.463638 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:31.464087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:32.165424 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fb69c5ac-a816-4400-9a75-6b7bc6a0cf57 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715614 Jun 15 22:24:32.166029 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 493/1002] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 15 22:24:31 2022] POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:24:39.971541 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:39.972141 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:39.974803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:39.975460 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=74 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:39.981752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:39.982203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:39.982981 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:39.983432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:40.125340 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:40.134972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e301fc7f-5ca3-48f6-bdc0-97cf2e9271c3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1594 microversion: 2.1 time: 0.167083 Jun 15 22:24:40.135556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 510/1003] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:39 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1594 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:42.213804 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-7794d65a-53fa-4624-bf1b-304833d2a292 req-0b738c03-9b73-4fb7-b300-295aade727b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:42.218170 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:42.219122 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:42.220115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:42.232301 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7794d65a-53fa-4624-bf1b-304833d2a292 req-0b738c03-9b73-4fb7-b300-295aade727b6 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:42.233096 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7794d65a-53fa-4624-bf1b-304833d2a292 req-0b738c03-9b73-4fb7-b300-295aade727b6 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:42.257633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-7794d65a-53fa-4624-bf1b-304833d2a292 req-0b738c03-9b73-4fb7-b300-295aade727b6 service nova] Creating event network-changed:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:24:42.265225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-7794d65a-53fa-4624-bf1b-304833d2a292 req-0b738c03-9b73-4fb7-b300-295aade727b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056232 Jun 15 22:24:42.266354 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 494/1004] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:24:43.710566 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-608672955"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:43.711109 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:43.719283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:43.719841 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:43.720786 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:43.721347 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:43.894656 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.network.security_group_api [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Adding security group e18ddfb1-1c3f-446e-93af-688977387561 to port b290f9e3-ac76-4d1f-8a23-b2ecaed26988 Jun 15 22:24:44.367845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cb26a167-6ac4-47f0-8d6d-779a4f30d9d2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/action" status: 202 len: 0 microversion: 2.1 time: 0.661170 Jun 15 22:24:44.368457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 511/1005] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:24:43 2022] POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 22:24:44.379205 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:24:44.379914 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:24:44.382183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-094c4cdb-946f-4119-8c38-af76b01ac18d req-6a5a3478-926f-4200-806c-263df2abf6ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:44.389981 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:44.390846 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:44.394740 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:44.397243 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-094c4cdb-946f-4119-8c38-af76b01ac18d req-6a5a3478-926f-4200-806c-263df2abf6ae service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:24:44.398532 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-094c4cdb-946f-4119-8c38-af76b01ac18d req-6a5a3478-926f-4200-806c-263df2abf6ae service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:44.410674 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:24:44.426664 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-094c4cdb-946f-4119-8c38-af76b01ac18d req-6a5a3478-926f-4200-806c-263df2abf6ae service nova] Creating event network-changed:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:24:44.438760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-094c4cdb-946f-4119-8c38-af76b01ac18d req-6a5a3478-926f-4200-806c-263df2abf6ae service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061935 Jun 15 22:24:44.439374 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 512/1006] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:24:44.879311 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:24:44.899692 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-74a6f9f7-18a4-4641-ad6e-d12960f98997 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1759 microversion: 2.1 time: 0.526060 Jun 15 22:24:44.901314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 495/1007] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:24:44 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1759 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:24:52.865935 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-138b1e1a-456b-4fd2-bd11-05cb40118999 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Action: 'create', calling method: .version_select at 0x7f99db2dd670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-358890117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyayZy8w1qhh79kclIli5AhQUFobPchG/Ya7Cn4SKHreS473Ix68g7SPLkoyPPEhpG+/D9lLTpQKc6HWWk3OQCGlmJ71aPyN68R4PoAg68v07oJrHjGYuePw2f2OVhSWQ=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:24:52.880612 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-138b1e1a-456b-4fd2-bd11-05cb40118999 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:24:52.884860 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-138b1e1a-456b-4fd2-bd11-05cb40118999 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for user c8785472d62341b1bf159153a7296ade and project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:24:52.913343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-138b1e1a-456b-4fd2-bd11-05cb40118999 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.231292 Jun 15 22:24:52.914097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 513/1008] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 15 22:24:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:25:07.806398 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:07.807530 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:07.810625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:07.811454 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:07.819566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:07.820285 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:07.821061 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:07.821549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:07.908312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-187c9c3a-8171-4ab9-a02b-6443c38c6a08 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/action" status: 202 len: 0 microversion: 2.1 time: 0.106949 Jun 15 22:25:07.909246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 496/1009] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:25:07 2022] POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:25:07.916699 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=12 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:07.917970 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=4 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:07.918900 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:07.923238 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:07.924218 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:07.933938 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:07.934344 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:07.935126 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:07.935550 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:08.085562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:08.094482 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fa127e9a-866b-4bc7-b9af-d0de513601e6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1751 microversion: 2.1 time: 0.179099 Jun 15 22:25:08.095049 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 514/1010] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:07 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:09.114130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:09.114800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:09.121706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:09.122160 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:09.122931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:09.123395 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:09.273569 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:09.283138 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-713da5ec-2eee-408b-95e0-0869a0b607cc tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.173817 Jun 15 22:25:09.283781 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 497/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:09 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:09.362279 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-611465828", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-358890117", "security_groups": [{"name": "tempest-secgroup-smoke-512557397"}], "block_device_mapping_v2": [{"uuid": "abf4a02c-3c65-46f5-bede-26a8a023a0c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ea215f8-963a-4d80-bf2d-45673a94edf0"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:09.491731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] validate_networks() for [('1ea215f8-963a-4d80-bf2d-45673a94edf0', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:25:09.892077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:25:09.892619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:25:09.893388 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:25:09.893983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:25:09.894621 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:25:09.905919 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:09.906331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:09.907128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:09.907536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:09.925407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:25:09.930025 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for user c8785472d62341b1bf159153a7296ade and project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:25:09.993738 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:25:09.995850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abf4a02c-3c65-46f5-bede-26a8a023a0c8',volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:25:10.146493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR oslo.messaging._drivers.impl_rabbit [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [339add90-bc38-46d7-b286-5c91dedd6dae] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 22:25:10.302405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:10.302996 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:10.311003 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:10.311451 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:10.312221 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:10.312650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:10.468584 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:10.480273 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-796538f9-db92-4254-b769-095b056f2026 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.181398 Jun 15 22:25:10.481233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 498/1012] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:10 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:11.155516 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [339add90-bc38-46d7-b286-5c91dedd6dae] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 50274. Jun 15 22:25:11.159886 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-425e47c9-222f-4318-a2ed-3a0d919b3023 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.801566 Jun 15 22:25:11.160564 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 515/1013] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:25:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:25:11.170852 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82c3153d-3d67-4777-9cd7-849da8d71783 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:11.171466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-82c3153d-3d67-4777-9cd7-849da8d71783 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:11.229679 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-82c3153d-3d67-4777-9cd7-849da8d71783 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:11.236758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-82c3153d-3d67-4777-9cd7-849da8d71783 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1093 microversion: 2.1 time: 0.069880 Jun 15 22:25:11.237307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 499/1014] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:11 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:11.503409 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:11.503913 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:11.511195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:11.511634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:11.512393 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:11.512823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:11.673013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:11.684337 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-07b14128-a56a-4b07-afdf-d675e2cc0b6a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.185505 Jun 15 22:25:11.684939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 516/1015] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:11 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:12.254551 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-544ff452-1b71-47f1-ba0e-b9b91c7890ec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:12.255246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-544ff452-1b71-47f1-ba0e-b9b91c7890ec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:12.309587 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-544ff452-1b71-47f1-ba0e-b9b91c7890ec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:12.317053 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-544ff452-1b71-47f1-ba0e-b9b91c7890ec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1093 microversion: 2.1 time: 0.066508 Jun 15 22:25:12.317648 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 500/1016] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:12 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:12.706165 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:12.706757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:12.713620 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:12.714357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:12.715118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:12.715544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:12.866985 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:12.876892 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2ce5206d-b660-4b37-9f92-937ae7f9d94a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.174598 Jun 15 22:25:12.877501 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 517/1017] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:12 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:13.337658 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7002dfd1-ff13-4be2-9983-2111ad0e7eb5 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:13.338279 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7002dfd1-ff13-4be2-9983-2111ad0e7eb5 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:13.402821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7002dfd1-ff13-4be2-9983-2111ad0e7eb5 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:13.409701 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7002dfd1-ff13-4be2-9983-2111ad0e7eb5 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1093 microversion: 2.1 time: 0.077464 Jun 15 22:25:13.410474 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 501/1018] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:13 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:13.895809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:13.896416 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:13.903947 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:13.904395 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:13.905157 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:13.905628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:14.052944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:14.065731 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-33a2ab11-7bc9-4d3e-bfdf-9ffb5af45a6b tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.173733 Jun 15 22:25:14.066469 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 518/1019] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:13 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:14.427824 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-564c41cb-8ce3-432b-8ff2-3efb12e7e89f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:14.428427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-564c41cb-8ce3-432b-8ff2-3efb12e7e89f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:14.488118 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-564c41cb-8ce3-432b-8ff2-3efb12e7e89f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:14.501133 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-564c41cb-8ce3-432b-8ff2-3efb12e7e89f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1093 microversion: 2.1 time: 0.076634 Jun 15 22:25:14.502420 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 502/1020] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:14 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:15.084612 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:15.085223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:15.092369 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:15.092825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:15.093625 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:15.094063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:15.241231 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:15.249633 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3ab54eec-bf95-4f37-a1a1-8366eb285ee6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.169025 Jun 15 22:25:15.250197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 519/1021] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:15 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:15.518900 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:15.519521 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:15.526874 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:15.527335 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:15.528107 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:15.528544 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:15.593517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:15.605369 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2ead4e28-5422-4c9d-b92b-3721c26b3fec tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1143 microversion: 2.1 time: 0.090237 Jun 15 22:25:15.606225 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 503/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:15 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:16.271233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:16.271846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:16.279192 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:16.279627 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:16.280408 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:16.280847 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:16.439911 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:16.448227 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d9e189fe-5e2f-4c57-9a80-5b8f4a9e8856 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.180914 Jun 15 22:25:16.449061 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 520/1023] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:16 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:16.628274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:16.628896 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:16.636586 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:16.637016 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:16.638013 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:16.638450 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:16.738357 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:16.748389 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7b699b69-cdf9-43e7-b2d2-32e604acba64 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1209 microversion: 2.1 time: 0.124022 Jun 15 22:25:16.749078 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 504/1024] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:16 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:17.466582 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:17.467391 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:17.474366 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:17.474904 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:17.475700 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:17.476118 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:17.644727 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:17.654747 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e1396a8e-42e5-4378-8d25-416f2ecefb4f tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.192169 Jun 15 22:25:17.656172 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 521/1025] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:17 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:17.766903 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:17.767632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:17.775503 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:17.775954 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:17.776731 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:17.777164 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:17.854449 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-cf562631-ffd0-457d-8f8a-288b20a983f4 req-1182fd20-a9a8-43e7-b99d-2cfe7ad4449b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3", "tag": "d1225cc3-5c3c-4baf-8721-bd30f3aad6a1"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:17.873562 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-cf562631-ffd0-457d-8f8a-288b20a983f4 req-1182fd20-a9a8-43e7-b99d-2cfe7ad4449b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:17.874016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-cf562631-ffd0-457d-8f8a-288b20a983f4 req-1182fd20-a9a8-43e7-b99d-2cfe7ad4449b service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:17.897078 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-cf562631-ffd0-457d-8f8a-288b20a983f4 req-1182fd20-a9a8-43e7-b99d-2cfe7ad4449b service nova] Creating event network-changed:d1225cc3-5c3c-4baf-8721-bd30f3aad6a1 for instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 on hv-cinder-83538 Jun 15 22:25:17.906771 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-cf562631-ffd0-457d-8f8a-288b20a983f4 req-1182fd20-a9a8-43e7-b99d-2cfe7ad4449b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060338 Jun 15 22:25:17.907407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 522/1026] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:25:17.977241 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:17.985977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-62a53782-1c79-48ab-ac71-a9e3a4a1ebfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.224115 Jun 15 22:25:17.986568 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 505/1027] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:17 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:18.673921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:18.674605 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:18.681387 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:18.681865 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:18.682653 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:18.683318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:18.833982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:18.845093 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3ec99882-5080-4e41-a0b7-4e2bc68570d6 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1756 microversion: 2.1 time: 0.176366 Jun 15 22:25:18.845710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 523/1028] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:18 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:19.008352 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:19.009144 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:19.017725 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:19.018177 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:19.018951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:19.019388 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:19.161625 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:19.170430 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-37ce97e9-9ee3-4c95-8843-337905be53f4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.168764 Jun 15 22:25:19.171000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 506/1029] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:19 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:19.863359 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:19.863998 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:19.870591 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:19.871036 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:19.871799 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:19.872409 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:19.914351 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:19.937424 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:20.024978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:20.033734 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f92164f7-e20e-406c-8cf2-15e6d436ea4a tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1759 microversion: 2.1 time: 0.174368 Jun 15 22:25:20.034346 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 524/1030] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:19 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:20.189009 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:20.189640 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:20.196618 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:20.197066 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:20.197865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:20.198323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:20.352660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:20.361060 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-05a9c03d-5fa3-4b4c-907e-d54bfc7ed740 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.176234 Jun 15 22:25:20.361687 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 507/1031] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:20 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:21.387141 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:21.387983 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:21.395613 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:21.396075 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:21.396855 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:21.397291 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:21.547966 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:21.558219 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f2ffffba-d176-4b64-b486-1f3c32bef9ba tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.177249 Jun 15 22:25:21.559078 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 525/1032] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:21 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:22.577645 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:22.578242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:22.585257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:22.585749 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:22.586546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:22.586974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:22.732971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:22.741361 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fdd07a79-d3ec-46bc-b7bf-f8f3cd99eaaa tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.167872 Jun 15 22:25:22.741965 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 508/1033] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:22 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:23.759197 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:23.759765 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:23.766787 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:23.767241 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:23.768016 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:23.768460 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:23.913377 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:23.914926 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:23.915608 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:23.925244 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-67525443-e785-4828-90ff-33947497237a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.170001 Jun 15 22:25:23.925458 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:23.926051 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:23.926211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 526/1034] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:23 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:23.927113 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:23.927750 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:23.957535 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lazy-loading 'flavor' on Instance uuid 5367c9f5-b5ab-4113-8ff2-48bddaa98baf {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:25:24.038259 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1cd72395-0d0c-433c-bedc-e31ccc9a8f33 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "POST /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf/action" status: 202 len: 0 microversion: 2.1 time: 0.129281 Jun 15 22:25:24.039023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 509/1035] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:25:23 2022] POST /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:25:24.047538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:24.048223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:24.054865 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:24.055426 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:24.056281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:24.056772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:24.194986 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:24.206007 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7ec4d63d-98a3-4630-838c-054e3d18dbd5 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.162426 Jun 15 22:25:24.206590 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 527/1036] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:24 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:24.948316 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:24.949032 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:24.951145 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:24.957750 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:24.958193 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:24.958961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:24.959394 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:25.110427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:25.119404 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6f47986c-1094-4111-aede-23e5b381db95 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.175403 Jun 15 22:25:25.119966 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 510/1037] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:24 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:25.226220 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:25.226773 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:25.234814 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:25.235269 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:25.236043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:25.236592 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:25.381559 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:25.389728 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-60edbecb-61e6-4cf6-8ade-95a02020b6de tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.167590 Jun 15 22:25:25.390303 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 528/1038] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:25 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:26.137270 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:26.137964 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:26.144874 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:26.145342 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:26.146121 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:26.146555 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:26.303705 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:26.311491 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-39756d67-044c-4e3e-87be-ef65ff2b2aa1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.178329 Jun 15 22:25:26.312104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 511/1039] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:26 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:26.407723 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:26.408306 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:26.415305 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:26.415920 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:26.416714 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:26.417146 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:26.561896 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:26.575064 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5ebf18a3-bdb5-488d-a2dd-7638bf3b5770 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.171184 Jun 15 22:25:26.575910 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 529/1040] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:26 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:27.331338 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:27.332019 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:27.338746 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:27.339208 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:27.339981 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:27.340418 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:27.485958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:27.493663 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3b58ac2c-0cd0-40d0-b5ff-12e1f052b770 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.167457 Jun 15 22:25:27.494233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 512/1041] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:27 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:27.595283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:27.595832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:27.603025 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:27.603469 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:27.604226 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:27.604665 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:27.751802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:27.760266 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-68a15328-f9cc-417e-95d5-423cd989e419 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.169094 Jun 15 22:25:27.760845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 530/1042] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:27 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:28.512716 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:28.513357 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:28.521466 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:28.521916 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:28.522701 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:28.523140 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:28.543350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:28.675741 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:28.683447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f5dc546f-13ce-42fb-83c4-6c02fea1e3b2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.176516 Jun 15 22:25:28.684020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 513/1043] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:28 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:28.783471 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:28.784031 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:28.793932 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:28.794594 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:28.795792 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:28.796415 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:28.941033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:28.944565 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:28.949742 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-18d8f0b9-ab5c-486e-be97-9d3c7cc9a655 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.172374 Jun 15 22:25:28.950328 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 531/1044] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:28 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:29.701564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:29.702184 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:29.709273 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:29.709763 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:29.710546 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:29.710985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:29.947960 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:29.956431 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-24d1e95c-bf02-49f6-aeda-042278481ac4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.259420 Jun 15 22:25:29.966061 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 514/1045] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:29 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:29.967191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:29.967824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:29.975626 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:29.976013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:29.977004 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:29.977663 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:30.023069 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-d8b690f5-f56d-4173-b37c-e6d2cbcdc9ad req-f1ac694b-4bfe-404b-8d60-010b1e00be71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3", "name": "network-vif-plugged", "status": "completed", "tag": "d1225cc3-5c3c-4baf-8721-bd30f3aad6a1"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:30.032646 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-d8b690f5-f56d-4173-b37c-e6d2cbcdc9ad req-f1ac694b-4bfe-404b-8d60-010b1e00be71 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:30.033290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-d8b690f5-f56d-4173-b37c-e6d2cbcdc9ad req-f1ac694b-4bfe-404b-8d60-010b1e00be71 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:30.048684 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-d8b690f5-f56d-4173-b37c-e6d2cbcdc9ad req-f1ac694b-4bfe-404b-8d60-010b1e00be71 service nova] Creating event network-vif-plugged:d1225cc3-5c3c-4baf-8721-bd30f3aad6a1 for instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 on hv-cinder-83538 Jun 15 22:25:30.054547 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-d8b690f5-f56d-4173-b37c-e6d2cbcdc9ad req-f1ac694b-4bfe-404b-8d60-010b1e00be71 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045912 Jun 15 22:25:30.055542 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 515/1046] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:25:30.127020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:30.135727 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1fbebcda-0cc3-47a0-82a8-ebfbc84b8047 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.172251 Jun 15 22:25:30.136515 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 532/1047] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:29 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:30.975767 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:30.976472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:30.983693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:30.984197 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:30.985000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:30.985539 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:31.139332 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:31.147274 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c194e43-7f73-4805-8c6f-ba5cc2487000 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1264 microversion: 2.1 time: 0.176956 Jun 15 22:25:31.147861 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 516/1048] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:30 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:31.153617 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:31.154226 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:31.160943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:31.161971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:31.162725 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:31.163169 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:31.309962 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:31.318306 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-563cc833-8d2b-4c94-880a-98c229bf707d tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.169327 Jun 15 22:25:31.318878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 533/1049] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:31 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:32.164707 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:32.165401 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:32.172407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:32.172830 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:32.173655 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:32.174086 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:32.311807 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:32.320188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fb9f8804-f003-4739-9606-d44dda3610ff tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1451 microversion: 2.1 time: 0.159572 Jun 15 22:25:32.320759 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 517/1050] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:32 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:32.337615 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:32.338211 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:32.341065 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:32.341706 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:32.345023 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:32.345510 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:32.346281 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:32.346708 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:32.347924 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:32.348480 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:32.349411 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:32.349842 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:32.486343 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:32.489307 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:32.494733 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4b95eef9-cb39-4863-bcd6-ef5df2caac02 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1451 microversion: 2.1 time: 0.161176 Jun 15 22:25:32.495316 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 534/1051] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:32 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:32.497449 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b66fbdcb-d59a-4fd5-b94c-8fabb6f75713 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.160126 Jun 15 22:25:32.498154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 518/1052] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:32 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:33.516080 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:33.516645 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:33.524079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:33.524553 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:33.525358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:33.525807 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:33.736240 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:33.744660 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-34e04b02-825d-429b-b4b6-59295ee31c10 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.232522 Jun 15 22:25:33.745460 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 535/1053] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:33 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:34.583635 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-b232e54a-7fcc-45fb-bf35-172507382e5b req-2e093343-8a80-46b6-a6e8-c5f3dc8f8573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3", "tag": "d1225cc3-5c3c-4baf-8721-bd30f3aad6a1"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:34.592797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b232e54a-7fcc-45fb-bf35-172507382e5b req-2e093343-8a80-46b6-a6e8-c5f3dc8f8573 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:34.593290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b232e54a-7fcc-45fb-bf35-172507382e5b req-2e093343-8a80-46b6-a6e8-c5f3dc8f8573 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:34.605729 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-b232e54a-7fcc-45fb-bf35-172507382e5b req-2e093343-8a80-46b6-a6e8-c5f3dc8f8573 service nova] Creating event network-changed:d1225cc3-5c3c-4baf-8721-bd30f3aad6a1 for instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 on hv-cinder-83538 Jun 15 22:25:34.610753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-b232e54a-7fcc-45fb-bf35-172507382e5b req-2e093343-8a80-46b6-a6e8-c5f3dc8f8573 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030935 Jun 15 22:25:34.611572 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 519/1054] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:25:34.761984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:34.763247 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:34.769753 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:34.770432 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:34.771259 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:34.771634 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:34.920317 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:34.928436 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4d3d6cbb-4599-430c-bfb9-df0793a17ded tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.170252 Jun 15 22:25:34.929225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 536/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:34 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:35.947465 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:35.948161 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:35.954917 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:35.955363 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:35.956121 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:35.956550 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:36.111824 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:36.120188 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8fbedcac-c746-48fc-9762-13d8fa664baa tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.178218 Jun 15 22:25:36.120747 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 520/1056] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:35 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:37.137882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:37.138492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:37.145811 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:37.146273 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:37.147046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:37.147479 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:37.304069 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:37.312930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7199dc80-bdc9-419e-bf5e-7f43729c5308 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.179983 Jun 15 22:25:37.313528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 537/1057] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:37 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:38.332343 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:38.332948 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:38.335602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=59 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:38.341851 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:38.342296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:38.343080 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:38.343515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:38.494189 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:38.505880 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dd5a3880-ca4f-4ff2-aa58-442ddd391c12 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1512 microversion: 2.1 time: 0.177197 Jun 15 22:25:38.506680 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 521/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:38 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:38.535536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:38.536128 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:38.539024 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:38.544636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:38.545088 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:38.545865 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:38.546285 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:38.641822 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-91d747d6-759c-4212-b8a1-b8cc3fcc8a22 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "POST /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf/action" status: 202 len: 0 microversion: 2.1 time: 0.110402 Jun 15 22:25:38.642636 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 538/1059] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:25:38 2022] POST /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:25:38.651294 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:38.651912 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:38.658648 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:38.659110 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:38.659889 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:38.660326 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:38.799800 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:38.812335 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8d3fdd43-b903-42f2-a54c-dc9375e0e532 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1520 microversion: 2.1 time: 0.165437 Jun 15 22:25:38.812911 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 522/1060] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:38 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:39.830809 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:39.831338 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:39.839040 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:39.839614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:39.840413 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:39.840895 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:39.983738 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:39.997696 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-042bd8b5-9cc4-4e86-bdaf-4e84b148bde7 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1522 microversion: 2.1 time: 0.171412 Jun 15 22:25:39.998288 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 539/1061] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:39 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:40.029132 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-c92fa269-130c-43eb-8ce1-7f80fb894e62 req-c182959c-7414-4488-bb22-08a61c3bd7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "name": "network-vif-unplugged", "status": "completed", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:40.039409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c92fa269-130c-43eb-8ce1-7f80fb894e62 req-c182959c-7414-4488-bb22-08a61c3bd7a0 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:40.039848 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c92fa269-130c-43eb-8ce1-7f80fb894e62 req-c182959c-7414-4488-bb22-08a61c3bd7a0 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:40.053886 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-c92fa269-130c-43eb-8ce1-7f80fb894e62 req-c182959c-7414-4488-bb22-08a61c3bd7a0 service nova] Creating event network-vif-unplugged:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:25:40.058791 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-c92fa269-130c-43eb-8ce1-7f80fb894e62 req-c182959c-7414-4488-bb22-08a61c3bd7a0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033730 Jun 15 22:25:40.059554 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 523/1062] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:25:41.015788 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:41.016403 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:41.025486 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:41.025936 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:41.026682 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:41.027145 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:41.177156 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:41.185640 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f5da546b-b5ba-4260-a764-c8901ea8e32a tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.173706 Jun 15 22:25:41.186222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 540/1063] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:41 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:42.204707 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:42.205435 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:42.212432 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:42.212879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:42.213703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:42.214146 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:42.350322 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:42.361946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fb4c466b-d56c-4df4-9fde-99569a18c0ae tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.162094 Jun 15 22:25:42.362717 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 524/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:42 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:43.380230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:43.380802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:43.388171 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:43.388611 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:43.389370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:43.389803 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:43.543091 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:43.551002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-63eea30c-13dc-4f84-b76b-30d70c0ad557 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.174862 Jun 15 22:25:43.551579 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 541/1065] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:43 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:44.568660 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:44.569242 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:44.577092 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:44.577693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:44.578703 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:44.579228 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:44.791973 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:44.799812 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-65c774c8-98d5-4bdc-ba61-c6ec8cabd6d0 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.235310 Jun 15 22:25:44.800380 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 525/1066] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:44 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:45.818043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:45.818658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:45.825818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:45.826275 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:45.827043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:45.827477 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:46.036583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:46.044796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-44f95ca5-6b13-4d67-bc1c-86589aef7145 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.230659 Jun 15 22:25:46.045371 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 542/1067] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:45 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:47.063913 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:47.064602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:47.074182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:47.074633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:47.075414 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:47.075854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:47.222844 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:47.232214 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e3b2f284-0919-44bd-b2fa-b7295c4570b3 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.174227 Jun 15 22:25:47.233093 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 526/1068] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:47 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:48.250392 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:48.250982 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:48.258191 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:48.258724 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:48.259980 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:48.260404 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:48.403177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:48.415070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-87da7f12-66e0-44b7-a577-e99262dbb533 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.168288 Jun 15 22:25:48.415811 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 543/1069] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:48 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:49.434044 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:49.434984 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:49.442447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:49.442931 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:49.443714 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:49.444149 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:49.584154 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:49.595597 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-700868f3-a93d-4b89-84de-013a88dc757e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.165960 Jun 15 22:25:49.596350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 527/1070] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:49 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:50.613692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:50.614295 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:50.620591 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:50.621033 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:50.621843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:50.622266 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:50.759543 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:50.767474 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b295f15d-d50c-4631-b282-c99276ffd4cf tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.157668 Jun 15 22:25:50.767976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 544/1071] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:50 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:51.785557 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:51.786194 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:51.793348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:51.793797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:51.794573 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:51.795009 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:51.938708 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:51.950765 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e3b682ce-9e2a-4cae-b89f-2f8307177f1b tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.168917 Jun 15 22:25:51.951517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 528/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:51 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:52.117043 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-62745124-116a-4f1f-9851-50197d8c722c req-4ad046f9-72de-4853-93d8-e55a73c00586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "name": "network-vif-plugged", "status": "completed", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:52.127130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-62745124-116a-4f1f-9851-50197d8c722c req-4ad046f9-72de-4853-93d8-e55a73c00586 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:52.127545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-62745124-116a-4f1f-9851-50197d8c722c req-4ad046f9-72de-4853-93d8-e55a73c00586 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:52.140597 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-62745124-116a-4f1f-9851-50197d8c722c req-4ad046f9-72de-4853-93d8-e55a73c00586 service nova] Creating event network-vif-plugged:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:25:52.145957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-62745124-116a-4f1f-9851-50197d8c722c req-4ad046f9-72de-4853-93d8-e55a73c00586 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Jun 15 22:25:52.146575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 545/1073] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:25:52.972194 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:52.972809 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:52.980387 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:52.980887 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:52.981696 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:52.982139 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:53.133649 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:53.141782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-90cb5447-61f3-4d01-a9d6-6760d51ae7ed tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1578 microversion: 2.1 time: 0.173630 Jun 15 22:25:53.142392 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 529/1074] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:52 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:54.160791 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:25:54.161556 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:54.168469 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:54.169101 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:54.169901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:54.170328 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:54.310659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:25:54.318457 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d9f14c7e-09dd-44dd-8991-d6b92b6e1c0e tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1565 microversion: 2.1 time: 0.162691 Jun 15 22:25:54.319014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 546/1075] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:25:54 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:25:58.531977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-608672955"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:58.532820 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:25:58.540338 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:58.540801 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:58.541613 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:58.542091 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:58.675879 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.network.security_group_api [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Removing security group e18ddfb1-1c3f-446e-93af-688977387561 from port b290f9e3-ac76-4d1f-8a23-b2ecaed26988 Jun 15 22:25:59.043589 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0c707224-5e50-4d43-9dde-a6fdedfcea59 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/action" status: 202 len: 0 microversion: 2.1 time: 0.515658 Jun 15 22:25:59.044610 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 530/1076] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 15 22:25:58 2022] POST /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:25:59.053944 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-fd4bba83-6fec-405e-b6c4-83d87982a266 req-d9072a82-ada4-44b7-a292-3ccb0daa2c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:25:59.064797 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-fd4bba83-6fec-405e-b6c4-83d87982a266 req-d9072a82-ada4-44b7-a292-3ccb0daa2c6e service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:25:59.065555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-fd4bba83-6fec-405e-b6c4-83d87982a266 req-d9072a82-ada4-44b7-a292-3ccb0daa2c6e service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:25:59.070322 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:59.087545 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-fd4bba83-6fec-405e-b6c4-83d87982a266 req-d9072a82-ada4-44b7-a292-3ccb0daa2c6e service nova] Creating event network-changed:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:25:59.094427 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-fd4bba83-6fec-405e-b6c4-83d87982a266 req-d9072a82-ada4-44b7-a292-3ccb0daa2c6e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043983 Jun 15 22:25:59.095502 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 547/1077] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:26:00.200467 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:00.201030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:00.203476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-a5e058d7-4a76-4b97-aebd-f8d2c78ac8ec req-38035910-59b5-4b4e-aba8-32dc82eac498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:26:00.207732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:00.208161 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:00.209052 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:00.209536 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:00.212341 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=91 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:26:00.215905 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a5e058d7-4a76-4b97-aebd-f8d2c78ac8ec req-38035910-59b5-4b4e-aba8-32dc82eac498 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:00.216359 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a5e058d7-4a76-4b97-aebd-f8d2c78ac8ec req-38035910-59b5-4b4e-aba8-32dc82eac498 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:00.228168 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-a5e058d7-4a76-4b97-aebd-f8d2c78ac8ec req-38035910-59b5-4b4e-aba8-32dc82eac498 service nova] Creating event network-changed:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:26:00.245189 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-a5e058d7-4a76-4b97-aebd-f8d2c78ac8ec req-38035910-59b5-4b4e-aba8-32dc82eac498 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043835 Jun 15 22:26:00.245957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 548/1078] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:26:00.305818 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lazy-loading 'services' on Instance uuid 6b85f708-fb4d-4fbb-a54d-267125e92101 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:26:00.393920 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c9d6041f-793d-4a4b-813f-db764eb110f3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments/48e163fd-39b4-4384-9716-ab675f7d9763" status: 202 len: 0 microversion: 2.1 time: 0.197128 Jun 15 22:26:00.394654 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 531/1079] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:26:00 2022] DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments/48e163fd-39b4-4384-9716-ab675f7d9763 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:26:00.404013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:00.405177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:00.415147 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:00.415878 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:00.416909 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:00.418257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:00.450502 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4b38ec52-d632-468a-860d-e9c58540f2b4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050715 Jun 15 22:26:00.451631 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 549/1080] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:26:00 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:26:01.465442 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:01.466528 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:01.473588 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:01.474072 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:01.474882 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:01.475320 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:01.506562 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4f53015e-c661-4cee-944b-d98640cee8dd tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046382 Jun 15 22:26:01.507100 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 532/1081] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 15 22:26:01 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 22:26:01.519269 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:01.519829 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:01.528701 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:01.529162 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:01.529955 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:01.530392 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:01.618528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] HTTP exception thrown: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 is not attached to volume 48e163fd-39b4-4384-9716-ab675f7d9763 Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Request method failure captured: Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments/48e163fd-39b4-4384-9716-ab675f7d9763 HTTP/1.1 Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlvwNmaulBAtM617pR-_YkCaTT0Kzno6mVZFS0GP_ZOd1Vem2-3iHLzkHp7sRliG1RWyoAhL1E2tPrUrhR0WMBsKZxOINwLCXtzRf33F_gxjdw6-ENaDpw-ipl1QIycNHSRzgjHZhbpr3rC46Clm4HuCFjaIquBpGn093smSDw6W1UU Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0d141f1b8c984a5a9fbf2fb3c8f01b2b Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestMinimumBasicScenario-1234078392 Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:26:01.621358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d141f1b8c984a5a9fbf2fb3c8f01b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d141f1b8c984a5a9fbf2fb3c8f01b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d141f1b8c984a5a9fbf2fb3c8f01b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d141f1b8c984a5a9fbf2fb3c8f01b2b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestMinimumBasicScenario-1234078392 Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0d141f1b8c984a5a9fbf2fb3c8f01b2b Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1234078392 Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-TestMinimumBasicScenario-1234078392-project Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 0df0a42b2f2442e2a34b6538311212aa Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestMinimumBasicScenario-1234078392-project Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:26:01.622999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 is not attached to volume 48e163fd-39b4-4384-9716-ab675f7d9763 Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'server_id': '6b85f708-fb4d-4fbb-a54d-267125e92101', 'id': '48e163fd-39b4-4384-9716-ab675f7d9763'} Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 48e163fd-39b4-4384-9716-ab675f7d9763. Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:26:01.623796 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 is not attached to volume 48e163fd-39b4-4384-9716-ab675f7d9763 Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 is not attached to volume 48e163fd-39b4-4384-9716-ab675f7d9763 Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:01.625489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Returning 404 to user: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 is not attached to volume 48e163fd-39b4-4384-9716-ab675f7d9763 {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:26:01.626869 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7827e342-8b60-497c-94b6-5c52e346c4cf tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments/48e163fd-39b4-4384-9716-ab675f7d9763" status: 404 len: 154 microversion: 2.1 time: 0.109316 Jun 15 22:26:01.626869 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 550/1082] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 15 22:26:01 2022] DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101/os-volume_attachments/48e163fd-39b4-4384-9716-ab675f7d9763 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:26:02.769436 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:02.769974 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:02.778489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:02.778937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:02.779713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:02.780186 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:02.805490 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:26:02.895344 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f0ed6943-2560-4b4d-8b6c-16b9c2ab3da4 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 204 len: 0 microversion: 2.1 time: 0.129533 Jun 15 22:26:02.896324 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 533/1083] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:26:02 2022] DELETE /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:26:02.909047 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:02.909744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:02.918313 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:02.918817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:02.919817 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:02.920248 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:03.059939 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:26:03.071223 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e0f62098-5938-4621-a8ca-cec76bcdf015 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1554 microversion: 2.1 time: 0.168169 Jun 15 22:26:03.071876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 551/1084] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:26:02 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:26:04.096183 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:04.096864 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:04.104012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:04.104463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:04.105255 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:04.106365 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:04.256888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:26:04.265076 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-115477df-e9fd-496f-8184-b08be2f8c9a3 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1554 microversion: 2.1 time: 0.175767 Jun 15 22:26:04.265690 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 534/1085] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:26:04 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:26:05.283245 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:05.283877 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:05.290922 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:05.291407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:05.292140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:05.292571 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:05.367561 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df0a42b2f2442e2a34b6538311212aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:26:05.377182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-156bb6c0-3d4e-4acb-ae95-89edfba3202d tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 200 len: 1512 microversion: 2.1 time: 0.097887 Jun 15 22:26:05.378054 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 552/1086] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:26:05 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 1512 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:26:05.409834 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-6157791e-523a-41ee-98f8-d62067645139 req-9838ec28-330b-492a-8cb9-6733212e826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85f708-fb4d-4fbb-a54d-267125e92101", "name": "network-vif-deleted", "tag": "b290f9e3-ac76-4d1f-8a23-b2ecaed26988"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:26:05.423880 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-6157791e-523a-41ee-98f8-d62067645139 req-9838ec28-330b-492a-8cb9-6733212e826a service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:05.424323 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-6157791e-523a-41ee-98f8-d62067645139 req-9838ec28-330b-492a-8cb9-6733212e826a service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:05.445049 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-6157791e-523a-41ee-98f8-d62067645139 req-9838ec28-330b-492a-8cb9-6733212e826a service nova] Creating event network-vif-deleted:b290f9e3-ac76-4d1f-8a23-b2ecaed26988 for instance 6b85f708-fb4d-4fbb-a54d-267125e92101 on hv-cinder-83538 Jun 15 22:26:05.455797 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-6157791e-523a-41ee-98f8-d62067645139 req-9838ec28-330b-492a-8cb9-6733212e826a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049568 Jun 15 22:26:05.456751 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 535/1087] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:26:06.395455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:06.396081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [instance: 6b85f708-fb4d-4fbb-a54d-267125e92101] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:26:06.404056 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:06.404528 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:06.405368 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:26:06.405863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:26:06.421757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] HTTP exception thrown: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 could not be found. Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Request method failure captured: Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 HTTP/1.1 Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlvwNmaulBAtM617pR-_YkCaTT0Kzno6mVZFS0GP_ZOd1Vem2-3iHLzkHp7sRliG1RWyoAhL1E2tPrUrhR0WMBsKZxOINwLCXtzRf33F_gxjdw6-ENaDpw-ipl1QIycNHSRzgjHZhbpr3rC46Clm4HuCFjaIquBpGn093smSDw6W1UU Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 0d141f1b8c984a5a9fbf2fb3c8f01b2b Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestMinimumBasicScenario-1234078392 Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:26:06.423310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d141f1b8c984a5a9fbf2fb3c8f01b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d141f1b8c984a5a9fbf2fb3c8f01b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d141f1b8c984a5a9fbf2fb3c8f01b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d141f1b8c984a5a9fbf2fb3c8f01b2b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestMinimumBasicScenario-1234078392 Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 0d141f1b8c984a5a9fbf2fb3c8f01b2b Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1234078392 Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-TestMinimumBasicScenario-1234078392-project Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: 0df0a42b2f2442e2a34b6538311212aa Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestMinimumBasicScenario-1234078392-project Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 could not be found. Jun 15 22:26:06.424906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '6b85f708-fb4d-4fbb-a54d-267125e92101'} Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 could not be found. Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:26:06.426021 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 could not be found. Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 could not be found. Jun 15 22:26:06.427309 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:26:06.428692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Returning 404 to user: Instance 6b85f708-fb4d-4fbb-a54d-267125e92101 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:26:06.428692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-42880b3f-15a0-4db0-b417-c76c107c57ae tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101" status: 404 len: 111 microversion: 2.1 time: 0.033530 Jun 15 22:26:06.428692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 553/1088] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:26:06 2022] GET /compute/v2.1/servers/6b85f708-fb4d-4fbb-a54d-267125e92101 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:26:06.438310 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b2f0292b-085a-4c9c-bed1-5d3edc7f00c2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] Calling method '.version_select at 0x7f99db2b19d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:26:06.442898 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b2f0292b-085a-4c9c-bed1-5d3edc7f00c2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [4e2aca71-6db1-487a-af61-f37740a54b4f] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 22:26:07.452238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [None req-b2f0292b-085a-4c9c-bed1-5d3edc7f00c2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] [4e2aca71-6db1-487a-af61-f37740a54b4f] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 50502. Jun 15 22:26:07.483538 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b2f0292b-085a-4c9c-bed1-5d3edc7f00c2 tempest-TestMinimumBasicScenario-1234078392 tempest-TestMinimumBasicScenario-1234078392-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1143524641" status: 202 len: 0 microversion: 2.1 time: 1.052950 Jun 15 22:26:07.484423 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 536/1089] 10.222.0.55 () {58 vars in 1271 bytes} [Wed Jun 15 22:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1143524641 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:27:08.465558 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=33 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:08.466347 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:08.466995 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:08.467823 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=29 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:08.472461 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:08.473069 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:08.479818 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:08.480276 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:08.481087 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:08.481589 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:08.511934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:27:08.601267 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-07ae4dde-1ecb-4a18-aeb9-821a8968dc48 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 204 len: 0 microversion: 2.1 time: 0.137237 Jun 15 22:27:08.606299 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 554/1090] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:27:08 2022] DELETE /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:27:08.611699 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:08.612976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:08.619512 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:08.619951 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:08.620720 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:08.621214 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:08.683899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-c44abace-d544-49b2-9d2e-3a2a400b3959 req-93f60bab-8315-4112-9117-45535e7b0f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:08.695403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c44abace-d544-49b2-9d2e-3a2a400b3959 req-93f60bab-8315-4112-9117-45535e7b0f39 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:08.695938 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c44abace-d544-49b2-9d2e-3a2a400b3959 req-93f60bab-8315-4112-9117-45535e7b0f39 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:08.707482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-c44abace-d544-49b2-9d2e-3a2a400b3959 req-93f60bab-8315-4112-9117-45535e7b0f39 service nova] Creating event network-changed:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:27:08.713906 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-c44abace-d544-49b2-9d2e-3a2a400b3959 req-93f60bab-8315-4112-9117-45535e7b0f39 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250072 Jun 15 22:27:08.714736 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 537/1091] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:27:08.765219 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:08.773849 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-33c2e61c-6cdf-4be6-81ba-d729caecf030 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.166227 Jun 15 22:27:08.774680 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 555/1092] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:08 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:09.795298 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:09.796360 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:09.807460 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:09.808110 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:09.809284 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:09.809957 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:10.041039 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:10.049686 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cd30a611-d39b-4fc3-87a6-49f5239384ca tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1571 microversion: 2.1 time: 0.260617 Jun 15 22:27:10.050243 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 538/1093] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:09 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1571 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:11.050890 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-621c5ae6-b6c1-4bdc-9aee-95739e8fcca7 req-654c344c-9b88-480b-8e21-e5b3e3fb9b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5367c9f5-b5ab-4113-8ff2-48bddaa98baf", "name": "network-vif-deleted", "tag": "b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:11.059349 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-621c5ae6-b6c1-4bdc-9aee-95739e8fcca7 req-654c344c-9b88-480b-8e21-e5b3e3fb9b17 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:11.059925 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-621c5ae6-b6c1-4bdc-9aee-95739e8fcca7 req-654c344c-9b88-480b-8e21-e5b3e3fb9b17 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:11.069165 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:11.069940 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:11.071085 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-621c5ae6-b6c1-4bdc-9aee-95739e8fcca7 req-654c344c-9b88-480b-8e21-e5b3e3fb9b17 service nova] Creating event network-vif-deleted:b83c3e22-ea44-4b80-a3bf-3a82f3eddfaa for instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf on hv-cinder-83538 Jun 15 22:27:11.075956 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-621c5ae6-b6c1-4bdc-9aee-95739e8fcca7 req-654c344c-9b88-480b-8e21-e5b3e3fb9b17 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093996 Jun 15 22:27:11.076531 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 556/1094] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:27:11.076715 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:11.077089 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:11.077868 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:11.078325 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:11.410790 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb2ceaafe83f4d67ae9ea6492b21a850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc7b00884114a089c6d2c785fc8e9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:11.419157 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0d0aa45e-4604-47a6-8ca6-eb523d8ed567 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 200 len: 1220 microversion: 2.1 time: 0.354153 Jun 15 22:27:11.419817 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 539/1095] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:11 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 1220 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:27:12.441846 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:12.442725 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] [instance: 5367c9f5-b5ab-4113-8ff2-48bddaa98baf] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:12.450577 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:12.451050 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:12.451825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:12.452256 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:12.466899 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] HTTP exception thrown: Instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf could not be found. Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Request method failure captured: Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf HTTP/1.1 Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqluf1mdsumkjCmPHuz_4HtNzs3S3h4FN4DtDbwU-WFRqMibGU-wHF42PJPykqCiKuQQ-bPsMqvty5z6YCNOj5_0Bsb4d8HKgfkHQabusgBqFS1jUJvnByWLz1M8lv0LlVCjMd-9VhpxLpMcXE_N7k3O-2uJsTYaa1mS__kMtF2Ss_yM Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: 1bc7b00884114a089c6d2c785fc8e9ed Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestShelveInstance-220933062 Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:27:12.468575 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1bc7b00884114a089c6d2c785fc8e9ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1bc7b00884114a089c6d2c785fc8e9ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1bc7b00884114a089c6d2c785fc8e9ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1bc7b00884114a089c6d2c785fc8e9ed", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestShelveInstance-220933062 Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 1bc7b00884114a089c6d2c785fc8e9ed Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestShelveInstance-220933062 Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-TestShelveInstance-220933062-project Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: fb2ceaafe83f4d67ae9ea6492b21a850 Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestShelveInstance-220933062-project Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf could not be found. Jun 15 22:27:12.470177 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '5367c9f5-b5ab-4113-8ff2-48bddaa98baf'} Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf could not be found. Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:27:12.471010 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf could not be found. Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf could not be found. Jun 15 22:27:12.472752 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:27:12.474217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Returning 404 to user: Instance 5367c9f5-b5ab-4113-8ff2-48bddaa98baf could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:27:12.474217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-953783db-8ff8-4930-807c-c9b96d9f3a90 tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf" status: 404 len: 111 microversion: 2.1 time: 0.036083 Jun 15 22:27:12.474217 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 557/1096] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:12 2022] GET /compute/v2.1/servers/5367c9f5-b5ab-4113-8ff2-48bddaa98baf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:27:12.658375 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-af26bd78-0267-49a5-b51e-a2227d1f2e5c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] Calling method '.version_select at 0x7f99db2c3e50>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:12.679535 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-af26bd78-0267-49a5-b51e-a2227d1f2e5c tempest-TestShelveInstance-220933062 tempest-TestShelveInstance-220933062-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2118278866" status: 202 len: 0 microversion: 2.1 time: 0.024972 Jun 15 22:27:12.680452 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 540/1097] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Jun 15 22:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2118278866 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:27:31.938473 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:31.939070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:31.941533 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:31.942195 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:31.948484 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:31.948931 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:31.949733 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:31.950160 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:31.977557 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:27:32.060739 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-58bd4744-0244-4ede-886b-8a25d1ca8c06 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 204 len: 0 microversion: 2.1 time: 0.126335 Jun 15 22:27:32.061927 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 558/1098] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:27:31 2022] DELETE /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:27:32.069256 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=14 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:32.070029 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:32.074095 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:32.074697 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:32.085561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:32.086050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:32.086778 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:32.087207 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:32.495439 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:32.504951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e8bc50a8-60e9-4455-bd44-96f400559945 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1576 microversion: 2.1 time: 0.437108 Jun 15 22:27:32.505607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 541/1099] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:32 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1576 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:27:33.531105 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:33.531801 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:33.538582 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:33.539029 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:33.539802 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:33.540237 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:33.691954 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:33.699832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-af22b7d4-ad85-4157-acdc-0f540b082918 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1576 microversion: 2.1 time: 0.174369 Jun 15 22:27:33.700386 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 559/1100] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:33 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:34.718532 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:34.719152 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:34.726308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:34.726758 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:34.727541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:34.727977 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:34.840565 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:34.849657 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a16f204d-09a1-4961-beb5-6ac9e0a7d356 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 200 len: 1509 microversion: 2.1 time: 0.135247 Jun 15 22:27:34.850254 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 542/1101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:34 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 1509 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:35.074041 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-4c5ced32-e771-4597-b1f8-2d11657bfcf8 req-86eaf87b-f4da-432e-ba6b-e82995cb8daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3", "name": "network-vif-deleted", "tag": "d1225cc3-5c3c-4baf-8721-bd30f3aad6a1"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:35.084561 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4c5ced32-e771-4597-b1f8-2d11657bfcf8 req-86eaf87b-f4da-432e-ba6b-e82995cb8daf service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:35.085008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4c5ced32-e771-4597-b1f8-2d11657bfcf8 req-86eaf87b-f4da-432e-ba6b-e82995cb8daf service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:35.096824 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-4c5ced32-e771-4597-b1f8-2d11657bfcf8 req-86eaf87b-f4da-432e-ba6b-e82995cb8daf service nova] Creating event network-vif-deleted:d1225cc3-5c3c-4baf-8721-bd30f3aad6a1 for instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 on hv-cinder-83538 Jun 15 22:27:35.102068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-4c5ced32-e771-4597-b1f8-2d11657bfcf8 req-86eaf87b-f4da-432e-ba6b-e82995cb8daf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038670 Jun 15 22:27:35.103059 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 560/1102] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:27:35.866717 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:35.867628 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:35.874988 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:35.875444 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:35.876238 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:35.876699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:35.891564 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] HTTP exception thrown: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Request method failure captured: Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 HTTP/1.1 Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlwvFlO1cok4WCxZCz1IkDheb826BH0VT1-mnG3gNE3KY_mdowbkQxwRan4leJwvx2TEVhg00aD6mdHGSnV5Rf32512eqy7drRN2NoMGUFowB5w1Xbz5bujL-L4rNYlxY7ebJPwW5KCInuy6BFu4lai9fd25xUNvGFAHGoObK0OIUVE Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:27:35.893263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2f3d3513c1440cfb73ba8f3c791c21e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c8785472d62341b1bf159153a7296ade Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:27:35.895041 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3'} Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:27:35.896292 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:27:35.898777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:27:35.900426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Returning 404 to user: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:27:35.900426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dbb9e429-f88f-425e-9515-de2f615821f9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 404 len: 111 microversion: 2.1 time: 0.032489 Jun 15 22:27:35.900426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 543/1103] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:35 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:27:35.994224 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-247718229", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-358890117", "security_groups": [{"name": "tempest-secgroup-smoke-512557397"}], "block_device_mapping_v2": [{"uuid": "abf4a02c-3c65-46f5-bede-26a8a023a0c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ea215f8-963a-4d80-bf2d-45673a94edf0"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:36.112833 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] validate_networks() for [('1ea215f8-963a-4d80-bf2d-45673a94edf0', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:27:36.635997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:27:36.636422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:27:36.636893 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:27:36.637297 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:27:36.637735 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:27:36.648301 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:36.648749 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:36.649582 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:36.650020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:36.667586 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:27:36.672326 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for user c8785472d62341b1bf159153a7296ade and project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'ram', 'cores', 'instances'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:27:36.743888 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:27:36.746064 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abf4a02c-3c65-46f5-bede-26a8a023a0c8',volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:27:36.900993 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-da5fd216-1815-4158-a122-e331281d7175 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.911072 Jun 15 22:27:36.901721 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 561/1104] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:27:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:27:36.912714 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d305a2e2-4632-4787-9e64-606d91b0906c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:36.913359 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d305a2e2-4632-4787-9e64-606d91b0906c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:36.972694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d305a2e2-4632-4787-9e64-606d91b0906c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:36.979627 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d305a2e2-4632-4787-9e64-606d91b0906c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1093 microversion: 2.1 time: 0.070812 Jun 15 22:27:36.980196 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 544/1105] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:36 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:37.998804 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:37.999453 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:38.007311 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:38.007924 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:38.008710 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:38.009312 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:38.075972 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:38.084687 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-308c90f4-d467-4655-b254-c4ef2c07271e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1199 microversion: 2.1 time: 0.090516 Jun 15 22:27:38.085876 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 562/1106] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:37 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:39.102971 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:39.103590 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:39.111467 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:39.111919 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:39.112688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:39.113123 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:39.329187 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:39.339127 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f7e38d78-432b-4842-8986-fb53b1a92863 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.239856 Jun 15 22:27:39.340239 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 545/1107] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:39 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:39.573978 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-143ed1b7-bfe6-48f9-9247-ab22af856d3c req-65b7f326-bb4f-4acf-913b-cc9eaa7df99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5058d180-fedc-4c19-9d10-d53576e6305b", "tag": "32e0a221-c83b-423d-b637-ea2f103cc30a"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:39.588965 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-143ed1b7-bfe6-48f9-9247-ab22af856d3c req-65b7f326-bb4f-4acf-913b-cc9eaa7df99d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:39.589520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-143ed1b7-bfe6-48f9-9247-ab22af856d3c req-65b7f326-bb4f-4acf-913b-cc9eaa7df99d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:39.602760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-143ed1b7-bfe6-48f9-9247-ab22af856d3c req-65b7f326-bb4f-4acf-913b-cc9eaa7df99d service nova] Creating event network-changed:32e0a221-c83b-423d-b637-ea2f103cc30a for instance 5058d180-fedc-4c19-9d10-d53576e6305b on hv-cinder-83538 Jun 15 22:27:39.609087 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-143ed1b7-bfe6-48f9-9247-ab22af856d3c req-65b7f326-bb4f-4acf-913b-cc9eaa7df99d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041782 Jun 15 22:27:39.609730 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 563/1108] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:27:40.356518 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:40.357141 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:40.364693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:40.365152 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:40.365975 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:40.366409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:40.609908 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:40.618152 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-763c46a1-44f1-48f7-a734-b005edeec0d8 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.265391 Jun 15 22:27:40.618946 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 546/1109] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:40 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:41.638169 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:41.638832 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:41.646614 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:41.647070 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:41.647857 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:41.648295 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:41.798307 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:41.806651 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-48eb3a0c-cbb7-4723-8f86-0a6e000c3e34 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.172895 Jun 15 22:27:41.807201 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 564/1110] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:41 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:42.830754 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:42.831516 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:42.838972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:42.839415 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:42.840297 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:42.840732 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:42.989233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:42.997463 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b1a6de18-e371-48be-a869-6ccb300629a4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.172878 Jun 15 22:27:42.998017 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 547/1111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:42 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:44.016431 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:44.017008 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:44.025890 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:44.026339 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:44.027107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:44.027544 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:44.177777 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:44.185862 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-82f8b889-87ad-400f-8779-1872b8ecb621 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.173555 Jun 15 22:27:44.186443 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 565/1112] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:44 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:45.206875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:45.207447 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:45.214661 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:45.215112 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:45.215895 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:45.216328 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:45.358350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:45.366727 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f2fd70c1-701d-4af0-81c4-630ee471d7d0 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.163924 Jun 15 22:27:45.367296 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 548/1113] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:45 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:46.386320 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:46.386906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:46.396476 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:46.397099 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:46.398283 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:46.398852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:46.543318 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:46.554357 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c8093aff-b805-4302-a372-a9d838544ebe tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.174144 Jun 15 22:27:46.554943 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 566/1114] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:46 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:47.579021 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:47.581561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:47.584290 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:47.590308 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:47.590761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:47.591526 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:47.591968 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:47.734770 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:47.746039 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9cd0f5c6-8032-4475-959a-8b24082f265f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.172326 Jun 15 22:27:47.746756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 549/1115] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:47 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:48.766236 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:48.767011 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:48.769239 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:48.769921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:48.777906 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:48.778355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:48.779150 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:48.779583 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:48.927219 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:48.935458 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2d8c4fea-c511-410c-9f79-b1712036f9ae tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.173112 Jun 15 22:27:48.936014 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 567/1116] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:48 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:49.957373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:49.958489 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:49.966257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:49.966773 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:49.967602 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:49.968087 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:50.105964 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:50.118458 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0d73c048-4d14-410e-b248-2a23ac29b8e3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.165363 Jun 15 22:27:50.119233 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 550/1117] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:49 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:50.930769 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-7b927292-16d0-4224-b747-1ea65ecf4ebc req-d4ee10ae-0a54-4564-a349-afae67a952a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5058d180-fedc-4c19-9d10-d53576e6305b", "name": "network-vif-plugged", "status": "completed", "tag": "32e0a221-c83b-423d-b637-ea2f103cc30a"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:50.939068 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7b927292-16d0-4224-b747-1ea65ecf4ebc req-d4ee10ae-0a54-4564-a349-afae67a952a5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:50.939498 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7b927292-16d0-4224-b747-1ea65ecf4ebc req-d4ee10ae-0a54-4564-a349-afae67a952a5 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:50.951077 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-7b927292-16d0-4224-b747-1ea65ecf4ebc req-d4ee10ae-0a54-4564-a349-afae67a952a5 service nova] Creating event network-vif-plugged:32e0a221-c83b-423d-b637-ea2f103cc30a for instance 5058d180-fedc-4c19-9d10-d53576e6305b on hv-cinder-83538 Jun 15 22:27:50.956190 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-7b927292-16d0-4224-b747-1ea65ecf4ebc req-d4ee10ae-0a54-4564-a349-afae67a952a5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209599 Jun 15 22:27:50.956766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 568/1118] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:27:51.140426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:51.141020 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:51.150082 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:51.150529 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:51.151332 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:51.151766 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:51.350097 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:51.363023 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b96f2ab9-39ff-4883-a504-ad29d9e1ab1b tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1264 microversion: 2.1 time: 0.226467 Jun 15 22:27:51.363895 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 551/1119] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:51 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:52.384454 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:52.385107 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:52.391921 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:52.392370 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:52.393140 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:52.393608 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:52.541225 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:52.551967 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c854da9-7505-4f10-9399-0fdf42a6ac83 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1451 microversion: 2.1 time: 0.173644 Jun 15 22:27:52.552772 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 569/1120] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:52 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:52.576854 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:27:52.577578 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:27:52.586440 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:52.586899 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:52.587675 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:52.588112 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:52.731356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:27:52.742410 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-63433d99-fdbd-4bfc-8d5e-e81696ca7cfd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1451 microversion: 2.1 time: 0.171678 Jun 15 22:27:52.742972 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 552/1121] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:27:52 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:27:54.658092 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-da50fd7e-fb4a-4eec-b304-2a102d561d6c req-90aafb28-e4fc-4749-9f71-c2918c7ab492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5058d180-fedc-4c19-9d10-d53576e6305b", "tag": "32e0a221-c83b-423d-b637-ea2f103cc30a"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:27:54.667003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-da50fd7e-fb4a-4eec-b304-2a102d561d6c req-90aafb28-e4fc-4749-9f71-c2918c7ab492 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:27:54.667517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-da50fd7e-fb4a-4eec-b304-2a102d561d6c req-90aafb28-e4fc-4749-9f71-c2918c7ab492 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:27:54.678766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-da50fd7e-fb4a-4eec-b304-2a102d561d6c req-90aafb28-e4fc-4749-9f71-c2918c7ab492 service nova] Creating event network-changed:32e0a221-c83b-423d-b637-ea2f103cc30a for instance 5058d180-fedc-4c19-9d10-d53576e6305b on hv-cinder-83538 Jun 15 22:27:54.684263 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-da50fd7e-fb4a-4eec-b304-2a102d561d6c req-90aafb28-e4fc-4749-9f71-c2918c7ab492 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029872 Jun 15 22:27:54.684850 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 570/1122] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:29:14.959650 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:29:14.960353 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Wed Jun 15 22:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:29:39.356821 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=26 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:39.357777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=62 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:39.362257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-714760857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-358890117", "security_groups": [{"name": "tempest-secgroup-smoke-512557397"}], "block_device_mapping_v2": [{"uuid": "e3622b10-defb-42d7-a244-58d4f170e0c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ea215f8-963a-4d80-bf2d-45673a94edf0"}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:29:39.494177 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] validate_networks() for [('1ea215f8-963a-4d80-bf2d-45673a94edf0', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 22:29:39.997626 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 22:29:39.998046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 22:29:39.998539 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 22:29:39.998942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 22:29:39.999348 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 22:29:40.009359 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:40.009725 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:40.010533 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:40.010933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:40.029779 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 22:29:40.034103 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Getting quotas for user c8785472d62341b1bf159153a7296ade and project b2f3d3513c1440cfb73ba8f3c791c21e. Resources: {'ram', 'cores', 'instances'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 22:29:40.100312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 22:29:40.102459 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3622b10-defb-42d7-a244-58d4f170e0c2',volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 22:29:40.257898 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7ea8a47f-1ada-4d64-9ba7-e46c7d65bcf9 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.906772 Jun 15 22:29:40.258549 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 553/1123] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 15 22:29:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 22:29:40.267703 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:40.268362 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:40.272880 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-49b1bc16-518c-46cf-8b5b-7231eed4226c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:40.273610 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-49b1bc16-518c-46cf-8b5b-7231eed4226c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:40.336760 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-49b1bc16-518c-46cf-8b5b-7231eed4226c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:40.344204 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-49b1bc16-518c-46cf-8b5b-7231eed4226c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1093 microversion: 2.1 time: 0.079055 Jun 15 22:29:40.344766 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 571/1124] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:40 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:41.359997 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a93cef46-9174-432c-b17f-7984364b32f3] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 22:29:41.364263 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:41.364777 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:41.372156 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:41.372948 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:41.373873 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:41.374392 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:41.462302 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:41.470409 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2b274eb4-a3df-4006-8f46-6437c555b3f7 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1209 microversion: 2.1 time: 0.111895 Jun 15 22:29:41.471086 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 554/1125] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:41 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:42.488340 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:42.488928 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:42.499063 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:42.499508 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:42.500282 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:42.500717 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:42.644327 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:42.652151 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b9d69a82-04e0-4ec6-9b0c-63124f8e0f0c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.167850 Jun 15 22:29:42.653310 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 572/1126] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:42 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:42.822735 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390973d5-9d2b-4fde-a9d7-bcfb51e8627b", "tag": "fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:29:42.843607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] [a93cef46-9174-432c-b17f-7984364b32f3] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 50846. Jun 15 22:29:42.848002 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:42.848482 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:42.861677 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] Creating event network-changed:fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d for instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b on hv-cinder-83538 Jun 15 22:29:42.865664 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR oslo.messaging._drivers.impl_rabbit [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] [db0c0e61-1b20-4856-bc7b-21417fb6279f] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 22:29:43.670360 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:43.670995 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:43.678041 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:43.678490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:43.679257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:43.679692 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:43.822133 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:43.830358 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-da7467c5-33ac-419d-90f0-1a6a09377dc6 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.164227 Jun 15 22:29:43.830928 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 573/1127] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:43 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:43.874930 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] [db0c0e61-1b20-4856-bc7b-21417fb6279f] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 50850. Jun 15 22:29:43.879461 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-032e84af-a3f7-4f98-bf5a-c0e0399db431 req-42b176a2-6c0a-40fc-bb24-2d716f51ed5d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.062232 Jun 15 22:29:43.880261 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 555/1128] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:29:44.847514 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:44.848134 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:44.857024 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:44.857668 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:44.858483 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:44.859144 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:44.998999 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:45.009839 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e5bbb0ca-1965-4594-8641-39e70f546f38 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.165855 Jun 15 22:29:45.010697 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 574/1129] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:44 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:46.031130 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:46.031932 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:46.038937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:46.039392 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:46.040173 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:46.040589 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:46.181486 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:46.189925 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3b486e6a-5e4b-47e1-8494-e89fd0dc6be1 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.163758 Jun 15 22:29:46.190508 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 556/1130] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:46 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:47.208490 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:47.209079 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:47.216422 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:47.216852 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:47.217652 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:47.218081 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:47.364467 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:47.375950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0aaaea6a-f226-485a-b3f7-9874770bf0cd tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.171206 Jun 15 22:29:47.376848 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 575/1131] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:47 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:48.398955 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:48.399541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:48.407012 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:48.407458 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:48.408327 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:48.408746 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:48.558782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:48.570104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d2d8e744-1703-46cf-97a4-4cabe33fff36 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.175177 Jun 15 22:29:48.570695 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 557/1132] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:48 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:49.589959 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:49.590554 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:49.598751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:49.599203 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:49.599950 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:49.600399 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:49.744516 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:49.755292 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ce7590c3-a3d7-4041-98c8-5dc7b0315f09 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.170708 Jun 15 22:29:49.755894 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 576/1133] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:49 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:50.774472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:50.775046 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:50.777691 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:50.778375 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:50.785737 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:50.791888 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:50.792688 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:50.793121 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:50.952125 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:50.961909 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-921f8ad4-2fe6-478a-a473-fdfa30ebb106 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.191396 Jun 15 22:29:50.962470 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 558/1134] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:50 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:51.979372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:51.979974 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:51.981912 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:51.987744 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:51.988182 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:51.989525 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:51.989957 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:52.136492 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:52.145489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d6e62788-a2fb-4502-afb4-f5f6313dd530 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.169754 Jun 15 22:29:52.146110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 577/1135] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:51 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:53.271632 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:53.272412 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:53.278951 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:53.279541 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:53.280407 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:53.280978 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:53.378019 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-72c30295-2e4d-4ef8-be26-57bb48c43b32 req-9cb19f20-94af-499e-b2ad-0b23d36a0f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390973d5-9d2b-4fde-a9d7-bcfb51e8627b", "name": "network-vif-plugged", "status": "completed", "tag": "fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:29:53.387853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-72c30295-2e4d-4ef8-be26-57bb48c43b32 req-9cb19f20-94af-499e-b2ad-0b23d36a0f53 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:53.388346 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-72c30295-2e4d-4ef8-be26-57bb48c43b32 req-9cb19f20-94af-499e-b2ad-0b23d36a0f53 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:53.401013 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-72c30295-2e4d-4ef8-be26-57bb48c43b32 req-9cb19f20-94af-499e-b2ad-0b23d36a0f53 service nova] Creating event network-vif-plugged:fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d for instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b on hv-cinder-83538 Jun 15 22:29:53.414179 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-72c30295-2e4d-4ef8-be26-57bb48c43b32 req-9cb19f20-94af-499e-b2ad-0b23d36a0f53 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039752 Jun 15 22:29:53.415493 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 578/1136] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:29:53.435204 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:53.443178 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b225e0e3-12f2-41cf-86b8-24aec4ec4b9e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.284017 Jun 15 22:29:53.443865 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 559/1137] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:53 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:54.463946 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:54.464666 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:54.471902 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:54.472628 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:54.473863 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:54.474371 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:54.624727 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:54.633407 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c0d64539-983b-40e5-a67b-6011ce72c82f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1264 microversion: 2.1 time: 0.175879 Jun 15 22:29:54.633975 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 579/1138] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:54 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:55.653474 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:55.654204 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:55.664272 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:55.665014 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:55.666325 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:55.666921 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:55.821495 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:55.829350 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f6d0b7cc-e82c-4b21-8998-6279936cb9c3 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1451 microversion: 2.1 time: 0.181957 Jun 15 22:29:55.829933 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 560/1139] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:55 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:29:55.849002 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:29:55.849976 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:29:55.859520 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:55.860183 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:55.861372 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:55.861997 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:56.012268 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:29:56.024086 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a2195f4b-fd64-4732-88ca-0834835e731e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1451 microversion: 2.1 time: 0.181445 Jun 15 22:29:56.024694 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 580/1140] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:29:55 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:29:57.748666 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-01ffd089-4f11-4a40-ad65-8b6737f15406 req-96445ae6-91c2-4dbb-9a9e-81bfd9db15a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390973d5-9d2b-4fde-a9d7-bcfb51e8627b", "tag": "fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:29:57.757426 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-01ffd089-4f11-4a40-ad65-8b6737f15406 req-96445ae6-91c2-4dbb-9a9e-81bfd9db15a2 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:29:57.757937 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-01ffd089-4f11-4a40-ad65-8b6737f15406 req-96445ae6-91c2-4dbb-9a9e-81bfd9db15a2 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:29:57.771782 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-01ffd089-4f11-4a40-ad65-8b6737f15406 req-96445ae6-91c2-4dbb-9a9e-81bfd9db15a2 service nova] Creating event network-changed:fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d for instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b on hv-cinder-83538 Jun 15 22:29:57.778045 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-01ffd089-4f11-4a40-ad65-8b6737f15406 req-96445ae6-91c2-4dbb-9a9e-81bfd9db15a2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032985 Jun 15 22:29:57.778648 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 561/1141] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:30:41.949884 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:30:41.950659 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Wed Jun 15 22:30:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:31:30.285355 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=22 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:30.286250 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=50 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:30.289633 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:30.290233 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:30.290517 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=42 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:30.290969 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:30.295357 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-93c6fbf6-3233-4a4b-9e08-8742e466d5d4 req-80a15f47-9ad2-4085-aae1-2b2c05f78936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390973d5-9d2b-4fde-a9d7-bcfb51e8627b", "tag": "fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:31:30.298595 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:30.299046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:30.299825 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:30.300257 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:30.306272 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-93c6fbf6-3233-4a4b-9e08-8742e466d5d4 req-80a15f47-9ad2-4085-aae1-2b2c05f78936 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:30.306713 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-93c6fbf6-3233-4a4b-9e08-8742e466d5d4 req-80a15f47-9ad2-4085-aae1-2b2c05f78936 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:30.319875 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-93c6fbf6-3233-4a4b-9e08-8742e466d5d4 req-80a15f47-9ad2-4085-aae1-2b2c05f78936 service nova] Creating event network-changed:fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d for instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b on hv-cinder-83538 Jun 15 22:31:30.325230 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-93c6fbf6-3233-4a4b-9e08-8742e466d5d4 req-80a15f47-9ad2-4085-aae1-2b2c05f78936 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039343 Jun 15 22:31:30.326135 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 562/1142] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:31:30.326298 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:31:30.410509 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fcb51192-a4d1-494b-a258-bf9874129bce tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "DELETE /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 204 len: 0 microversion: 2.1 time: 0.127050 Jun 15 22:31:30.413356 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 581/1143] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:31:30 2022] DELETE /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:31:30.430678 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:30.431377 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:30.438371 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:30.439090 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:30.440377 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:30.441314 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:30.898515 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:31:30.906474 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-072f21ea-93aa-40fc-93c3-8207b41761c4 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1576 microversion: 2.1 time: 0.490106 Jun 15 22:31:30.907098 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 563/1144] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:30 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1576 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:31:31.926929 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:31.927741 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:31.935650 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:31.936153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:31.936992 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:31.937517 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:32.162331 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:31:32.170234 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bfcf00b0-0d45-45b7-9e6e-e40a6e38b017 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1576 microversion: 2.1 time: 0.248934 Jun 15 22:31:32.170808 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 582/1145] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:31 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:31:32.686403 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-8afee6a4-1d34-4ce5-86db-9f6f93053d25 req-02a2be65-3189-4927-bb1f-4a91941a0794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390973d5-9d2b-4fde-a9d7-bcfb51e8627b", "name": "network-vif-deleted", "tag": "fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:31:32.695464 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8afee6a4-1d34-4ce5-86db-9f6f93053d25 req-02a2be65-3189-4927-bb1f-4a91941a0794 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:32.695855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8afee6a4-1d34-4ce5-86db-9f6f93053d25 req-02a2be65-3189-4927-bb1f-4a91941a0794 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:32.706945 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-8afee6a4-1d34-4ce5-86db-9f6f93053d25 req-02a2be65-3189-4927-bb1f-4a91941a0794 service nova] Creating event network-vif-deleted:fd2cc8d9-e80b-4fae-9d3e-4ef067d6190d for instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b on hv-cinder-83538 Jun 15 22:31:32.711850 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-8afee6a4-1d34-4ce5-86db-9f6f93053d25 req-02a2be65-3189-4927-bb1f-4a91941a0794 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029157 Jun 15 22:31:32.712437 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 564/1146] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 22:31:33.187588 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:33.188210 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:33.194992 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:33.195459 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:33.196222 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:33.196658 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:33.227540 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:33.227882 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:33.228330 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lazy-loading 'fault' on Instance uuid 390973d5-9d2b-4fde-a9d7-bcfb51e8627b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 22:31:33.269621 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:31:33.277383 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a5610c5c-d55b-4354-b48d-61b5c1e76f1c tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 200 len: 1229 microversion: 2.1 time: 0.093861 Jun 15 22:31:33.277971 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 583/1147] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:33 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:31:34.301845 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:34.302990 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 390973d5-9d2b-4fde-a9d7-bcfb51e8627b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:34.313545 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:34.313990 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:34.314756 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:34.315190 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:34.328920 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] HTTP exception thrown: Instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b could not be found. Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Request method failure captured: Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b HTTP/1.1 Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlwvFlO1cok4WCxZCz1IkDheb826BH0VT1-mnG3gNE3KY_mdowbkQxwRan4leJwvx2TEVhg00aD6mdHGSnV5Rf32512eqy7drRN2NoMGUFowB5w1Xbz5bujL-L4rNYlxY7ebJPwW5KCInuy6BFu4lai9fd25xUNvGFAHGoObK0OIUVE Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:31:34.330694 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2f3d3513c1440cfb73ba8f3c791c21e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c8785472d62341b1bf159153a7296ade Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b could not be found. Jun 15 22:31:34.332427 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '390973d5-9d2b-4fde-a9d7-bcfb51e8627b'} Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b could not be found. Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:31:34.333607 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b could not be found. Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b could not be found. Jun 15 22:31:34.335373 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:34.336958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Returning 404 to user: Instance 390973d5-9d2b-4fde-a9d7-bcfb51e8627b could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:31:34.336958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a7ea246-387f-47c5-a93f-b726ffa5c009 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b" status: 404 len: 111 microversion: 2.1 time: 0.038076 Jun 15 22:31:34.336958 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 565/1148] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:34 2022] GET /compute/v2.1/servers/390973d5-9d2b-4fde-a9d7-bcfb51e8627b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:31:37.440496 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:37.441035 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:37.442561 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-d2b3a400-1117-4fd1-a628-e727acc7b901 req-3d4707b3-d6d1-4a89-8fd5-c9580610bc92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5058d180-fedc-4c19-9d10-d53576e6305b", "tag": "32e0a221-c83b-423d-b637-ea2f103cc30a"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:31:37.448110 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:37.448845 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:37.449647 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:37.450084 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:37.453114 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-d2b3a400-1117-4fd1-a628-e727acc7b901 req-3d4707b3-d6d1-4a89-8fd5-c9580610bc92 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:37.453581 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-d2b3a400-1117-4fd1-a628-e727acc7b901 req-3d4707b3-d6d1-4a89-8fd5-c9580610bc92 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:37.465693 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-d2b3a400-1117-4fd1-a628-e727acc7b901 req-3d4707b3-d6d1-4a89-8fd5-c9580610bc92 service nova] Creating event network-changed:32e0a221-c83b-423d-b637-ea2f103cc30a for instance 5058d180-fedc-4c19-9d10-d53576e6305b on hv-cinder-83538 Jun 15 22:31:37.472339 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-d2b3a400-1117-4fd1-a628-e727acc7b901 req-3d4707b3-d6d1-4a89-8fd5-c9580610bc92 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033449 Jun 15 22:31:37.473249 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 566/1149] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:31:37.482123 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 22:31:37.582020 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4bdbc82c-c3dd-4d71-8a4a-3bb5b73276d2 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 204 len: 0 microversion: 2.1 time: 0.143271 Jun 15 22:31:37.586489 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 584/1150] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:31:37 2022] DELETE /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 22:31:37.592356 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:37.593061 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:37.599722 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:37.600428 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:37.601438 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:37.601877 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:37.746312 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:31:37.754030 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d68b2262-ce41-4613-baf8-4b3e95a4df04 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1574 microversion: 2.1 time: 0.166147 Jun 15 22:31:37.754595 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 567/1151] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:37 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 22:31:38.772872 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:38.773619 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:38.780455 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:38.780901 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:38.781706 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:38.782153 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:38.922843 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:31:38.931440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c7b96f8a-cb14-4146-bd06-17601ea24e2e tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1574 microversion: 2.1 time: 0.163002 Jun 15 22:31:38.932003 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 585/1152] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:38 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:31:39.876072 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-068249d4-7cae-4229-be6f-29eda513a74b req-8c56365c-06a6-47cc-bb9f-94807caa3637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5058d180-fedc-4c19-9d10-d53576e6305b", "name": "network-vif-deleted", "tag": "32e0a221-c83b-423d-b637-ea2f103cc30a"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 22:31:39.885591 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-068249d4-7cae-4229-be6f-29eda513a74b req-8c56365c-06a6-47cc-bb9f-94807caa3637 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:39.885963 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-068249d4-7cae-4229-be6f-29eda513a74b req-8c56365c-06a6-47cc-bb9f-94807caa3637 service nova] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:39.897761 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-068249d4-7cae-4229-be6f-29eda513a74b req-8c56365c-06a6-47cc-bb9f-94807caa3637 service nova] Creating event network-vif-deleted:32e0a221-c83b-423d-b637-ea2f103cc30a for instance 5058d180-fedc-4c19-9d10-d53576e6305b on hv-cinder-83538 Jun 15 22:31:39.902504 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-068249d4-7cae-4229-be6f-29eda513a74b req-8c56365c-06a6-47cc-bb9f-94807caa3637 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 Jun 15 22:31:39.903086 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 568/1153] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 15 22:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 22:31:39.948354 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:39.948934 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:39.956097 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:39.956538 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:39.957291 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:39.957757 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:40.021536 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8785472d62341b1bf159153a7296ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 22:31:40.033931 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-049df180-9390-4486-ad14-46694dda9748 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 200 len: 1224 microversion: 2.1 time: 0.089098 Jun 15 22:31:40.034853 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 586/1154] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:39 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 22:31:41.058862 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:41.060000 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 5058d180-fedc-4c19-9d10-d53576e6305b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:41.071050 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:41.071832 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:41.073104 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:41.073880 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:41.092182 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] HTTP exception thrown: Instance 5058d180-fedc-4c19-9d10-d53576e6305b could not be found. Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Request method failure captured: Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b HTTP/1.1 Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlwvFlO1cok4WCxZCz1IkDheb826BH0VT1-mnG3gNE3KY_mdowbkQxwRan4leJwvx2TEVhg00aD6mdHGSnV5Rf32512eqy7drRN2NoMGUFowB5w1Xbz5bujL-L4rNYlxY7ebJPwW5KCInuy6BFu4lai9fd25xUNvGFAHGoObK0OIUVE Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:31:41.093890 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2f3d3513c1440cfb73ba8f3c791c21e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c8785472d62341b1bf159153a7296ade Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 5058d180-fedc-4c19-9d10-d53576e6305b could not be found. Jun 15 22:31:41.095753 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '5058d180-fedc-4c19-9d10-d53576e6305b'} Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5058d180-fedc-4c19-9d10-d53576e6305b could not be found. Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:31:41.096829 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5058d180-fedc-4c19-9d10-d53576e6305b could not be found. Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5058d180-fedc-4c19-9d10-d53576e6305b could not be found. Jun 15 22:31:41.098257 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.099961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Returning 404 to user: Instance 5058d180-fedc-4c19-9d10-d53576e6305b could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:31:41.099961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5fdad91e-5552-4f5c-a892-343328ee0615 tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b" status: 404 len: 111 microversion: 2.1 time: 0.045124 Jun 15 22:31:41.099961 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 569/1155] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:41 2022] GET /compute/v2.1/servers/5058d180-fedc-4c19-9d10-d53576e6305b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:31:41.562046 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:41.562646 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:41.571532 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:41.571984 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:41.572751 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:41.573184 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:41.586555 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] HTTP exception thrown: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Request method failure captured: Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 HTTP/1.1 Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Connection: close Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Host: 10.222.0.55 Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABiqlwvFlO1cok4WCxZCz1IkDheb826BH0VT1-mnG3gNE3KY_mdowbkQxwRan4leJwvx2TEVhg00aD6mdHGSnV5Rf32512eqy7drRN2NoMGUFowB5w1Xbz5bujL-L4rNYlxY7ebJPwW5KCInuy6BFu4lai9fd25xUNvGFAHGoObK0OIUVE Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 15 22:31:41.588230 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2f3d3513c1440cfb73ba8f3c791c21e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Id: c8785472d62341b1bf159153a7296ade Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: method: > Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: exception: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.590870 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: action_args: {'id': '6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3'} Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:31:41.592440 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.595130 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.597444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Returning 404 to user: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:31:41.597444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d41f18cc-0495-4e54-8b8b-044a12cffeab tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 404 len: 111 microversion: 2.1 time: 0.033527 Jun 15 22:31:41.597444 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 587/1156] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 15 22:31:41 2022] DELETE /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:31:41.603029 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:41.603670 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] [instance: 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 22:31:41.610246 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:41.610701 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:41.611472 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 22:31:41.611892 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Lock "3e2fb47e-e475-4f13-884d-5122f57ae4d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 22:31:41.625699 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] HTTP exception thrown: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Request method failure captured: Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 HTTP/1.1 Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Connection: close Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Host: 10.222.0.55 Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABiqlwvFlO1cok4WCxZCz1IkDheb826BH0VT1-mnG3gNE3KY_mdowbkQxwRan4leJwvx2TEVhg00aD6mdHGSnV5Rf32512eqy7drRN2NoMGUFowB5w1Xbz5bujL-L4rNYlxY7ebJPwW5KCInuy6BFu4lai9fd25xUNvGFAHGoObK0OIUVE Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 15 22:31:41.627405 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2f3d3513c1440cfb73ba8f3c791c21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2f3d3513c1440cfb73ba8f3c791c21e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b2f3d3513c1440cfb73ba8f3c791c21e Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1950957748 Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Id: c8785472d62341b1bf159153a7296ade Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestVolumeBootPattern-1950957748-project Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: method: > Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: exception: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.629059 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: action_args: {'id': '6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3'} Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 22:31:41.633566 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. Jun 15 22:31:41.635115 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 15 22:31:41.636985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Returning 404 to user: Instance 6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 22:31:41.636985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7833b714-996b-489c-bc1b-288f9d3f862f tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jun 15 22:31:41.636985 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 570/1157] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 15 22:31:41 2022] GET /compute/v2.1/servers/6f8c1567-6c4c-4ae9-bbe0-a8d5bfb3deb3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 22:31:42.971170 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0d0ae16c-ae22-497e-b60b-2cebc97bf21a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] Calling method '.version_select at 0x7f99db6ce8b0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 22:31:42.994930 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0d0ae16c-ae22-497e-b60b-2cebc97bf21a tempest-TestVolumeBootPattern-1950957748 tempest-TestVolumeBootPattern-1950957748-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-358890117" status: 202 len: 0 microversion: 2.1 time: 0.027486 Jun 15 22:31:42.995356 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 588/1158] 10.222.0.55 () {58 vars in 1259 bytes} [Wed Jun 15 22:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-358890117 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 22:32:34.970209 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:32:34.971217 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Wed Jun 15 22:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:32:37.640241 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:32:37.641142 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Wed Jun 15 22:32:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:33:14.284621 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:33:14.285161 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Wed Jun 15 22:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:34:30.967675 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:34:30.968587 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Wed Jun 15 22:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:34:43.887079 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:34:43.887942 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Wed Jun 15 22:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:35:54.983276 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:35:54.984440 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Wed Jun 15 22:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:35:57.654089 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:35:57.655040 dv-cinder-835384-7-iscsi devstack@n-api.service[117629]: Wed Jun 15 22:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 22:36:34.294876 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 22:36:34.295855 dv-cinder-835384-7-iscsi devstack@n-api.service[117630]: Wed Jun 15 22:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!